-- Logs begin at Thu 2022-05-19 18:35:46 UTC, end at Thu 2022-05-19 20:40:46 UTC. -- May 19 19:42:40.012785 dv-cinder-835881-13-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 19:42:40.021993 dv-cinder-835881-13-smb devstack@keystone.service[80272]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 19:42:40 2022] *** May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: nodename: dv-cinder-835881-13-smb May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: machine: x86_64 May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: clock source: unix May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: pcre jit disabled May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: detected number of CPU cores: 4 May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: current working directory: / May 19 19:42:40.024030 dv-cinder-835881-13-smb devstack@keystone.service[80272]: detected binary path: /usr/bin/uwsgi-core May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: your processes number limit is 47680 May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: your memory page size is 4096 bytes May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: detected max file descriptor number: 2048 May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: lock engine: pthread robust mutexes May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: thunder lock: enabled May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 19:42:40.024699 dv-cinder-835881-13-smb devstack@keystone.service[80272]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 19:42:40.071978 dv-cinder-835881-13-smb devstack@keystone.service[80272]: Python main interpreter initialized at 0x55592dced9c0 May 19 19:42:40.071978 dv-cinder-835881-13-smb devstack@keystone.service[80272]: python threads support enabled May 19 19:42:40.071978 dv-cinder-835881-13-smb devstack@keystone.service[80272]: your server socket listen backlog is limited to 100 connections May 19 19:42:40.071978 dv-cinder-835881-13-smb devstack@keystone.service[80272]: your mercy for graceful operations on workers is 90 seconds May 19 19:42:40.072311 dv-cinder-835881-13-smb devstack@keystone.service[80272]: mapped 403077 bytes (393 KB) for 2 cores May 19 19:42:40.072386 dv-cinder-835881-13-smb devstack@keystone.service[80272]: *** Operational MODE: preforking *** May 19 19:42:40.072660 dv-cinder-835881-13-smb devstack@keystone.service[80272]: *** uWSGI is running in multiple interpreter mode *** May 19 19:42:40.072660 dv-cinder-835881-13-smb devstack@keystone.service[80272]: spawned uWSGI master process (pid: 80272) May 19 19:42:40.072867 dv-cinder-835881-13-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 19:42:40.073887 dv-cinder-835881-13-smb devstack@keystone.service[80272]: spawned uWSGI worker 1 (pid: 80283, cores: 1) May 19 19:42:40.073887 dv-cinder-835881-13-smb devstack@keystone.service[80272]: spawned uWSGI worker 2 (pid: 80284, cores: 1) May 19 19:42:40.073887 dv-cinder-835881-13-smb devstack@keystone.service[80272]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 19:42:45.730162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:42:45.730162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: from cryptography.utils import int_from_bytes May 19 19:42:45.730953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:42:45.730953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: from cryptography.utils import int_from_bytes May 19 19:42:45.730953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:42:45.730953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: from cryptography.utils import int_from_bytes May 19 19:42:45.731749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:42:45.731749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: from cryptography.utils import int_from_bytes May 19 19:42:45.780014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:42:45.780212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:42:45.780340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] command line args: [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:42:45.780434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:42:45.780550 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:42:45.780640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:42:45.780759 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] command line args: [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:42:45.780842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ================================================================================ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:42:45.781036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:42:45.781159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] admin_token = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ================================================================================ {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:42:45.781318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_dir = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781459 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] admin_token = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781686 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_source = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] config_dir = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] debug = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.781943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] config_source = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] debug = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782834 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.782954 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_config_append = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_config_append = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_dir = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.783930 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_dir = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784109 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784189 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_file = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784592 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.784874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785652 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.785931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786065 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786155 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786415 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.786922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.787036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.787169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.787294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.787432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.787917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.788067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] publish_errors = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.788319 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.788546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.788691 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.788963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789415 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] standard_threads = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.789970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] publish_errors = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_journal = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_json = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790589 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_stderr = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_syslog = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.790948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.791418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.791497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] standard_threads = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.791897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.791977 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.792076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.792162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.792256 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] use_journal = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.792364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.792444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] use_json = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.792595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] use_stderr = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.792672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.792770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] use_syslog = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.792847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:42:45.793080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793829 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.793987 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794463 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794806 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.794960 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795777 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.795928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796413 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.796981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797590 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.797908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798537 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.798869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799577 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.799872 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.800967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.801942 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802173 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802645 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802900 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.802992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803820 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.803897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.804964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805515 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.805892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806385 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.806952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807764 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.807938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.808947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809115 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.809935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.810970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811734 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.811975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812032 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812531 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812759 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812903 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.812986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.813977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814060 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.814945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815591 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.external = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.815919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816044 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816122 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.password = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.816880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.token = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.external = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.817909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818415 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.818969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.password = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] auth.token = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.819908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820146 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820288 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820773 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.820857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821759 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.821995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822798 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.822969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823686 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.823913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.824951 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825110 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825666 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825817 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.825895 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826151 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826419 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826798 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.826893 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827028 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.827978 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828205 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.828998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829459 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.829958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830664 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.830930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.831861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832333 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.832963 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.833897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834830 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.834914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.835847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836699 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.836940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837864 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.837943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838190 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838330 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838652 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.838929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839387 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839537 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839623 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839764 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.839995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840073 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.840923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.841940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842796 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.842875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843028 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843258 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.843975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.844976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845205 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845599 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.845913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846352 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.846933 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.847875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.848949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849184 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.849980 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] role.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.850967 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] role.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.851901 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852314 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.852879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853189 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.853925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.854951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.855919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856697 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.856942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857798 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.857878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.858849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859473 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859794 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.859938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.860963 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861131 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861217 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861454 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.861969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.862947 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863414 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863807 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.863885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.connection = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.864983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865062 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.865924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866386 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.866807 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:42:45.866879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.867102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.867334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.867575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.867804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.868047 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.868280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:42:45.868448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:42:45.897294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.897517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.897736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.897954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.898188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.898418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.906545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.907078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.934610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.934869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.934959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.935164 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.987044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:45.987195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.037779 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.038016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.038649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.038917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.102363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.102520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.102590 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.102808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.102959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103032 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103515 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.103671 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.126677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.126907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127125 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.127863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.128053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.128176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.128259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.139251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.139638 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.153729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.153877 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.153971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154575 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.154991 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80283) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.155126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:42:46.172100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.172222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:42:46.172535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.172662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.172765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:42:46.172847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:42:46.173021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173145 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:42:46.173533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.173823 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.174009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.174344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.184888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.185910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.186223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.193927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.194419 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.197218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.197501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.197741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.197870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.198972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199241 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.199812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.200031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.200160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.200281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.200571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.226581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.227272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.228209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.228484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.228902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.229194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.234044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.234320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.234595 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.234854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.235131 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.235420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.242025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.242304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.242841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.243129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.246902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.247188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.247466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.247739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.247882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.247990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.248951 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.249121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.249394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.249644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.267574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.267846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.268631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.268910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.272618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.273574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.276262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.276554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.277277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.277579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.281561 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.282661 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.285222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.286345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.289114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.289406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.289695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.289972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.290247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.290372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.290533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.290614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.290939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.291243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.291587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.291939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.309761 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.310127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.310395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.310660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.311114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.311493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.311764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.312032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.318668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.320147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.320395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.320673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.321892 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.322172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.323750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.324031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.324320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.324606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.324882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.325284 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.325564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.325845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.326153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.326414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.338363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.338639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.338945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.339226 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.339507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.339777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.340029 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.340155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.340325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.340612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.340896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.341175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.341438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.341711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.358518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.360289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.361833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.363912 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.367940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.368455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.369325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.370211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.371741 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.372078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.372177 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.372357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.372431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.372645 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.380223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.380964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.381862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.382579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.385159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.385455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.385747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.386032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.386721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.387213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.387511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.387785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.395407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.395705 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.395986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.400619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.400981 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.401279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.403958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80283) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.404242 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.404534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.404825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.405099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.405366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.405664 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.405925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.406204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.406470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.406754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.407028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.407303 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.407546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80283) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.409182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:42:46.409461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.409748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.410032 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.410301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.410587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.410882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.411145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.411421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.411684 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.411959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.412226 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.412498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.412753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:42:46.451833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55592dced9c0 pid: 80284 (default app) May 19 19:42:46.452394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55592dced9c0 pid: 80283 (default app) May 19 19:42:46.455274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d157-7a47-4f52-aa0e-0251e18c1385 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:46.455627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d157-7a47-4f52-aa0e-0251e18c1385 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:46.455900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d157-7a47-4f52-aa0e-0251e18c1385 None None] PATH_INFO: `/v3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:46.460286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu May 19 19:42:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:54.467729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.468338 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.468338 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.472692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:42:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:54.479557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:54.480306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:54.480438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:54.552312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: INFO dbcounter [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] Registered counter for database keystone May 19 19:42:54.577422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG oslo_db.sqlalchemy.engines [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:42:54.588875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writer thread running {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:42:54.776285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG passlib.handlers.bcrypt [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80284) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:42:54.776623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG passlib.handlers.bcrypt [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80284) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:42:54.832896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:54.834520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:54.965671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:42:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 19:42:55.163344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.236849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: INFO dbcounter [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] Registered counter for database keystone May 19 19:42:55.258608 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG oslo_db.sqlalchemy.engines [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:42:55.268350 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writer thread running {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:42:55.386273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409b90-890d-418b-be36-382f9ee4bebd None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.391714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0d82a958b6447d9133fc3135f67bd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.392382 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.392668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.393000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.402196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.453387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:42:55.453662 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccbeac-11dc-468b-8391-ef567dfb39bf admin admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.464238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:42:55.471343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:55.492236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc9665-d5dd-4d99-b814-c8f3d44aa355 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:55.497709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0d82a958b6447d9133fc3135f67bd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:55.498953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:55.499242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:55.499520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] PATH_INFO: `/v3/projects/db0d82a958b6447d9133fc3135f67bd6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:55.501263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] RBAC: Authorizing `identity:get_project(project_id=db0d82a958b6447d9133fc3135f67bd6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:55.662318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:42:55.662672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bd507-50c3-4063-b567-160b009a0c4e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:55.667498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu May 19 19:42:55 2022] GET /identity/v3/projects/db0d82a958b6447d9133fc3135f67bd6 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:42:57.956440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312628-b28c-4eff-a0f7-cd8a3de92e0e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.957237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312628-b28c-4eff-a0f7-cd8a3de92e0e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.957237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312628-b28c-4eff-a0f7-cd8a3de92e0e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.964008 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:42:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:42:57.970964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:57.971391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:57.971650 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:57.991962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:42:57.993497 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:42:58.003117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:42:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 19:42:58.026772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be312628-b28c-4eff-a0f7-cd8a3de92e0e None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.043512 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be312628-b28c-4eff-a0f7-cd8a3de92e0e None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.048615 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0d82a958b6447d9133fc3135f67bd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.049275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.049553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.049832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.057850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.059657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786064f-fde0-4148-b9f2-c1f5eefbcc89 admin admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.068379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:42:58.073673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:42:58.082571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5298-d70c-4216-bd7c-6f6e8ff2cafa None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:42:58.087505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db0d82a958b6447d9133fc3135f67bd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:42:58.088375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:42:58.088664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:42:58.088945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:42:58.090395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:42:58.092261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3317bd-9067-43c9-94c9-5b60c89a094c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:42:58.093825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu May 19 19:42:58 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.347109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29173-98e4-41a2-b3a8-7300b61a6d5e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.347684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29173-98e4-41a2-b3a8-7300b61a6d5e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.347684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29173-98e4-41a2-b3a8-7300b61a6d5e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.349021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:00.354400 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.354875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.354968 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.373043 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:00.374216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:00.374361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bec70-dea4-4e8a-a56f-1d4aa8bde4b8 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.374503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bec70-dea4-4e8a-a56f-1d4aa8bde4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.374833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bec70-dea4-4e8a-a56f-1d4aa8bde4b8 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.376174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:00.381246 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.381539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.381816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.421893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG passlib.handlers.bcrypt [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80283) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:43:00.422313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG passlib.handlers.bcrypt [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80283) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:43:00.455730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:00.468264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:00.469862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:00.478520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.502118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.569680 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:00.580877 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7f2c8-f28c-4a63-947f-9b85b1d960e1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.591867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.615938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.617207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.617581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.617865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.631760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:00.643118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:00.644234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:00.645105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:00.651101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.743084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.763509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302626f9-c402-4b0f-af4f-e9d6ec49a44c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.800223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.800907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.801183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.801464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.802221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:00.802532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.803979 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.810676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a105e7-f4df-415a-be1e-c191f4c567b6 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.813025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:00.816450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.821987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.850195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.851142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.851433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.851706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.921102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.922666 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.924170 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134edf5-28c1-41e0-a705-12e6b04f5b66 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:00.958983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:00.959911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:00.960201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:00.960456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:00.961678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:00.963189 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:00.965045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 9/16] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:00.970147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:00.984912 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.019426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 8/17] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:01.025079 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.027776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.069124 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03309b35-7521-43d0-a166-5a62d0668aa4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.103404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.104200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.104464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.104724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.105902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.107714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.109313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:01.115172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.122002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4dbb-aa94-4c18-a5b7-b62f86d58531 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.154927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.155723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.156006 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.156285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.175372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.176779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.193950 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:01.197746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:01.198643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:01.199575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:01.199575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:01.199575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:01.199575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:01.199575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:01.205325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:01.218348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4227fc-50f8-4473-a5de-bf1d1f8cebd6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.251638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.252355 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.252635 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.252914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.253753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.domain.id=default, user.id=39d45c6601e340739e7025d543a6a1d4) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:01.254071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.255565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54485f8-bf2e-4173-acf2-419afa769864 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.260596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:01.262771 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/role_assignments?user.id=39d45c6601e340739e7025d543a6a1d4&scope.domain.id=default&role.id=1a189ac8308b420aa77decb136a045a2 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:01.309241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423ee88-a728-44ed-b955-3988ff6599e4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:01.346183 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:01.346897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:01.347192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:01.347748 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:01.348222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:01.348534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:01.349970 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b5ac3-02b8-45bd-b04d-bd22ae0ea30b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:01.371642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:03.699245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57849d6e-b398-4199-a57b-cc73730a5f53 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.699787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57849d6e-b398-4199-a57b-cc73730a5f53 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.699787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57849d6e-b398-4199-a57b-cc73730a5f53 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.701232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:03.707198 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:03.708138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:03.708644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:03.739850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:03.741456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:03.830455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:03.864548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57849d6e-b398-4199-a57b-cc73730a5f53 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.000451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57849d6e-b398-4199-a57b-cc73730a5f53 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.046160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.046997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.047283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.047555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.063733 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3de5a00c-dd10-4283-99d2-08c6119ef494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:04.071494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:04.072339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:04.073120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 13/24] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:04.079577 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.083992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f70-88bc-4b0f-bca0-187364bb311b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.084522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f70-88bc-4b0f-bca0-187364bb311b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.085052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96f70-88bc-4b0f-bca0-187364bb311b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.086879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 14/25] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:04.092149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761ff8-443f-4d2f-81b3-07f3af728262 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.092700 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761ff8-443f-4d2f-81b3-07f3af728262 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.093185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70761ff8-443f-4d2f-81b3-07f3af728262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.104613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.123770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-70761ff8-443f-4d2f-81b3-07f3af728262 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:04.125411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-70761ff8-443f-4d2f-81b3-07f3af728262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:04.180064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.271002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 15/26] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:04.272277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112e30-5840-4734-8df9-cad353308a9b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.272547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112e30-5840-4734-8df9-cad353308a9b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.272830 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112e30-5840-4734-8df9-cad353308a9b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.274181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 16/27] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:04.281237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.281535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.281793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.300275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26f887-66d1-4055-a829-bf51429ff410 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.319983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:04.321208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:04.357598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.358295 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.358585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.358897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.359670 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.359985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.361487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.374387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 12/28] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.375085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.431993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 17/29] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:04.433190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.492680 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61bfcf-ab33-4b3a-adb8-a50d04aef2c5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.503295 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.532388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.533138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.533427 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.534067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.544700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.546395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.549574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:43:04.566390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:04.567288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:04.568088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:43:04.568088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:43:04.568088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:43:04.568088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:04.568088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 13/30] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:04.569100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.590513 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6b95b-1b54-4052-a33a-aaf0ad2af83e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.626962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.627904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.628196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.628477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.629734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.631254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112a86-7ed6-490d-95b5-a105bd726320 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.633097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 18/31] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.634153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f342e0-4f53-49fc-9d0c-1498f218482e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.634442 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f342e0-4f53-49fc-9d0c-1498f218482e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.634808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f342e0-4f53-49fc-9d0c-1498f218482e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.636077 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 19/32] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:04.637197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f342e0-4f53-49fc-9d0c-1498f218482e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.712830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2026d-4631-44a9-a81c-010d344457f9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.756595 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f342e0-4f53-49fc-9d0c-1498f218482e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.758258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.759273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.759627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.760799 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.761641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.763147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee75f92-6ea0-4215-8b7d-1e85c1870310 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.792647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:04.801241 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.802145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.802695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.803117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.804084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:04.804543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:04.806485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:04.827022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 20/33] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:04.828030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:04.918193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 14/34] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:43:04 2022] POST /identity/v3/roles => generated 219 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:04.928184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.928707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.929161 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:04.942641 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88032458-ba12-4228-a9d7-4b83aa4cfc88 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:04.959348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:04.961130 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:04.993526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:04.995489 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:04.996922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:04.998907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.001330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.001784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.004154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.008067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 21/35] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:05.008818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.092964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.144606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 15/36] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:05.145304 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.151494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7091fc4-3d33-44fb-a9dc-600fec5f092c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.203107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.203843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.204331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.204618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.205867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.207618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.304770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8dd49-7729-4d88-b74a-f427762a5bcd None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.342003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.342943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.343291 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.343523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] PATH_INFO: `/v3/domains/default/users/39d45c6601e340739e7025d543a6a1d4/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.346029 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39d45c6601e340739e7025d543a6a1d4, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.347746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e04d3-57eb-439a-b65c-a3dfaea68f85 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.361688 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 22/37] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:43:05 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:05.363242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.370517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 16/38] 10.222.0.77 () {58 vars in 1361 bytes} [Thu May 19 19:43:05 2022] PUT /identity/v3/domains/default/users/39d45c6601e340739e7025d543a6a1d4/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:05.521433 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b5c2-6028-4178-8a1a-9e5095189e25 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.544245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.576744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.577474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.577766 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.578050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.578873 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.580618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f07eb8-77cc-4018-8190-df7598ee51ff None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.608037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 23/39] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:43:05 2022] POST /identity/v3/roles => generated 225 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:05.625222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176eea-c71b-474e-a65f-43d505b40db0 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.625539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176eea-c71b-474e-a65f-43d505b40db0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.625801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176eea-c71b-474e-a65f-43d505b40db0 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.627411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 17/40] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:05.634500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.634500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.634500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.653619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:05.655232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:05.717982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dea35-2fa8-4337-bfcd-db39f4f456c7 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.719002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dea35-2fa8-4337-bfcd-db39f4f456c7 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.719498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dea35-2fa8-4337-bfcd-db39f4f456c7 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.721150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 18/41] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:05.727112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.727738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.728028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.737511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 24/42] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:05.762050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:05.763316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:05.767634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.768495 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.847357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 19/43] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:05.870775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:05.891039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379814c-3fbd-42b1-a8c5-87b1cfbc6f12 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:05.894496 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:05.940284 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:05.941100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:05.941393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:05.941695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:05.942469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:05.944162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:05.961107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 25/44] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:43:05 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:05.987923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da65675-4f7e-478d-85a4-6169f0010ef0 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.031835 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.033096 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.033582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.034807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.036364 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.038176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49572f0-d1de-4668-9611-56dab51d0f74 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.040139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 20/45] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:06.045783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:06.157998 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718eb0-0ccc-40af-ba2f-d9aa5e62860d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:06.192257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:06.192937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:06.193229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:06.193519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:06.194245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:06.195785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcc6b3-f7f9-4701-bcf1-85770b9cb41a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:06.221901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 26/46] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:43:06 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:07.745794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92bce-1cb2-4063-905c-4ec13a51d144 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.746310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92bce-1cb2-4063-905c-4ec13a51d144 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.746416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f92bce-1cb2-4063-905c-4ec13a51d144 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.747806 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 21/47] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:07.753261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:07.753726 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:07.753796 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:07.771565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:07.772771 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:07.782214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.844455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 27/48] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:07.868305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92bce-1cb2-4063-905c-4ec13a51d144 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:07.880277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:07.974647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f92bce-1cb2-4063-905c-4ec13a51d144 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.017874 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.018673 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.018981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.019250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.030923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:08.039907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:08.040771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:08.041554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 22/49] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:08.047099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.149097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27f966-0060-40ac-9c53-e5fad5103a1e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.183805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.184470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.184752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.185029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.185781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:08.186088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.187532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.195951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 28/50] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:08.201710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.275341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.309706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d5694-5a5d-4376-b01c-122ddbfdeab4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.344532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.345460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.346113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.346614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.348085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.349561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f036d-de95-4c52-acb1-e64f341f28ac None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.351684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 23/51] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:08.358898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.368588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.420336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad57a-da2e-462e-aab3-c6ff270bfe1c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.420718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad57a-da2e-462e-aab3-c6ff270bfe1c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.421053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ad57a-da2e-462e-aab3-c6ff270bfe1c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.422801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 24/52] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:08.428436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.429007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.429449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.449597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:08.450845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:08.467498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2880-8468-48e0-ae57-ca7d1df75611 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.502453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.503295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.503587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.503867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.505188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.506673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.508364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 29/53] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:08.514183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.517375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 25/54] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:08.540482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.591565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.603972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.617604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab085-7250-4f95-a4c3-773db7399168 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.640325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536faee-4998-4ad9-9d12-0c99bbe36c3f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.650217 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.651406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.651406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.651580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.652292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.domain.id=default, user.id=39d45c6601e340739e7025d543a6a1d4) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:08.652624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.654072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.660568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 30/55] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/role_assignments?user.id=39d45c6601e340739e7025d543a6a1d4&scope.domain.id=default&role.id=1a189ac8308b420aa77decb136a045a2 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:08.677552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.678385 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.678668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.680240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.681741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831d772-64bd-4e94-9762-d9b64a653b6c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.683504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 26/56] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:08.689364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:08.797879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e4095-76fb-46d4-ab3e-64791f68791d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:08.835012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:08.835695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:08.835970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:08.836248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:08.836969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:08.838433 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7ad0-87ca-4948-9f49-deb7ae1f2061 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:08.847313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:08.867132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 31/57] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 19:43:08 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:11.039880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3331ea-79fb-41a2-8165-33840278d6c5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.040407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3331ea-79fb-41a2-8165-33840278d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.040407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3331ea-79fb-41a2-8165-33840278d6c5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.041728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 27/58] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:11.048072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.048883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.048993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.067316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:11.068545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:11.137457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 32/59] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:11.161621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3331ea-79fb-41a2-8165-33840278d6c5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.278336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3331ea-79fb-41a2-8165-33840278d6c5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.316545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.317287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.317568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.317845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.319069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.320528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3b871-e003-4396-a959-0df4a7960a0f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.322119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 28/60] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:11.328237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:11.444172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6d336-ad60-4714-b762-0c8a4f1cdaed None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:11.467527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:11.490647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:11.491690 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:11.492080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:11.492467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:11.493571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:11.495937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cdff7-a6e8-47a6-adfd-a2c928aadd68 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:11.528204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 33/61] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:11 2022] POST /identity/v3/users => generated 275 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:14.954538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747fc3-2256-45f9-9724-c6e69713c942 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.955682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747fc3-2256-45f9-9724-c6e69713c942 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.956172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7747fc3-2256-45f9-9724-c6e69713c942 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.957767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 29/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:14.968576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3d10-7246-493c-a31f-aa10c4051239 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:14.969473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3d10-7246-493c-a31f-aa10c4051239 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:14.969952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a3d10-7246-493c-a31f-aa10c4051239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:14.995701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-aa0a3d10-7246-493c-a31f-aa10c4051239 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:14.997301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-aa0a3d10-7246-493c-a31f-aa10c4051239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.089049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 34/63] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:15.090293 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a16d-a797-4d9e-b5b4-6963a3cdc95f None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.090817 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a16d-a797-4d9e-b5b4-6963a3cdc95f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.091296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a16d-a797-4d9e-b5b4-6963a3cdc95f None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.092846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 30/64] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:15.098283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.098578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.098884 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.109999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55b51-7c77-4866-adb2-6600a715674c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.110588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55b51-7c77-4866-adb2-6600a715674c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.111142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55b51-7c77-4866-adb2-6600a715674c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.112703 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 31/65] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:15.117700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.117822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:15.118307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.118811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.119006 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.124232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.140389 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:15.141992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.194551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 35/66] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:15.196323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.216546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 32/67] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:15.225476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.268010 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.360044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a055f-6941-4039-934c-ac707c16cb83 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.371450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcec91-1dce-4c58-8404-866f7dae7f00 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.403088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.404240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.404624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.405016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.409873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.417819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.417964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:15.419033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.419520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.420018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:15.426677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:15.427574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:15.428322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 36/68] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:15.428961 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.435564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:15.444194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:15.445074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:15.445840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 33/69] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:15.446467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.528948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.535494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172cdb5-2723-49aa-9550-90df7bf9a35d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.555731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358abdd-226c-4a6d-8389-3fbf36d6c554 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.572182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.572987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.573272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.573552 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.584301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:15.591355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dd2907a6-fce2-4f09-a7f2-8f7d7363e7f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:15.591983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:15.592839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:15.593627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:15.594216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.594216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.594216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.594380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 37/70] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:15.594442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:15.594442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.594560 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711f2-8984-43ac-8bdb-1515c8ba07be None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.594624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711f2-8984-43ac-8bdb-1515c8ba07be None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.595254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988711f2-8984-43ac-8bdb-1515c8ba07be None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.595371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f7aa7-ba3e-4a5a-aa8a-01c8f95fa82e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.598208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 38/71] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:15.598208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988711f2-8984-43ac-8bdb-1515c8ba07be None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.605747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 34/72] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:15.607493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e0b9-c20a-41b4-8dbc-d4e59b3e8543 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.607788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e0b9-c20a-41b4-8dbc-d4e59b3e8543 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.608127 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9e0b9-c20a-41b4-8dbc-d4e59b3e8543 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.610895 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 35/73] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:15.610895 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9e0b9-c20a-41b4-8dbc-d4e59b3e8543 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.670811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.699946 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988711f2-8984-43ac-8bdb-1515c8ba07be None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.715014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9e0b9-c20a-41b4-8dbc-d4e59b3e8543 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.732281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bcb38-cc62-4865-a090-59122795119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.732955 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bcb38-cc62-4865-a090-59122795119e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.733246 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bcb38-cc62-4865-a090-59122795119e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.733527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bcb38-cc62-4865-a090-59122795119e None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.734283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bcb38-cc62-4865-a090-59122795119e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:15.734597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bcb38-cc62-4865-a090-59122795119e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.736088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bcb38-cc62-4865-a090-59122795119e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.743925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 39/74] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:15.745159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f759f9-07cd-4859-8289-d8e8fb4944f8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.745464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f759f9-07cd-4859-8289-d8e8fb4944f8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.745749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f759f9-07cd-4859-8289-d8e8fb4944f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.747947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.748630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.748902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.749179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.749925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:15.750236 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.751649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.760538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 36/75] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:15.761345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.762144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-56f759f9-07cd-4859-8289-d8e8fb4944f8 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:15.763373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-56f759f9-07cd-4859-8289-d8e8fb4944f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.776964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.829227 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 40/76] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:15.830514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.830834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.831119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.847231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:15.848405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:15.861059 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd939-72c7-450b-a91b-6ce4739eff9a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:15.877211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:15.896379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:15.897376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:15.897582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:15.897904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:15.913298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:15.914276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 41/77] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:15.914798 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:15.915214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.916637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 37/78] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:15.919508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:15.997991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.020407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1590b-c207-4d57-8407-7f765bbd8dff None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.020728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ba961-3773-4b04-a946-2c422f8800a7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.052839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.053209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.053719 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.054000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.054089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.054275 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.054373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.054633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.055565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.055871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.057019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.057492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.058843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 42/79] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.063319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 38/80] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:15 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.063441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.063527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.103540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.162070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d20e-1512-42bc-8e15-a672e1d34523 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.164487 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa01f7-b00f-4798-8e70-ff2be3e1a0b5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.195069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.195720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.196007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.196287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.197788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.198592 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.198913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.199192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.209388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:16.217059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:16.218086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:16.219188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 43/81] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:16.220056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.228193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.264766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.266257 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.305118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.317470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351a5a-3e39-4e82-b435-5bb6b7d7096b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.352120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.353026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.353393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.353741 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.354932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.356718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.358446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 44/82] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.359265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.365695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 39/83] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:16.365695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.438815 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.464267 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004311a9-bae2-4b54-a110-f58602b1308e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.464911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e638c-9256-478c-8e36-c5f6bb325c03 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.497770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.498269 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.498442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.498717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.498965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.499095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.499200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.499523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.510892 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.565612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.567140 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.567316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.568815 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.644216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.669467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 40/84] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:16.670154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.677547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 45/85] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:16.678493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.712911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.768605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1a5ed-2248-47f5-92b1-19e6af7dc492 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.780428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b989-e8cf-4b53-8368-00de669c27d4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.801948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.802632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.802940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.803225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.803995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:16.804305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.805707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.813923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 41/86] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.814802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.814987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.815636 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.815929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.816212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.816938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.818405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.839030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 46/87] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:16 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:16.839845 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:16.874648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.928506 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e02a-b3f4-477b-a624-49afa6aedef4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.931093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:16.962715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c365d-9237-4242-baba-1d2055aa5a9c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:16.966225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:16.967160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:16.967446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:16.967729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:16.969016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:16.970759 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:16.973700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 42/88] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:16.974375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.006121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.007084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.007379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.007666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.008919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.010443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.012287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 47/89] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.013073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.102819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669d41-3c4f-4691-adbf-ee86ec7c09b0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.134914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.139342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e429-bd4c-42c7-8e3e-9a4e70f760e1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.150002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.151032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.151323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.153679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.155001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.156492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.158595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 43/90] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:16 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.159410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.178606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.179717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.180010 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.180443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.181929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.183436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.185842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 48/91] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.186741 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.208318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.291543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbe83-be17-4a1a-8ea4-17521dde2f22 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.317394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1e29-2cc9-4e0d-ae66-d9314ee26d82 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.331327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.332425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.333250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.333534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.334536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.334955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.336816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.346023 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 44/92] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=6b1caefc1f754ef995ff5f010637468d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.347147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.365682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.366919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.367390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.368085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.369566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=39d45c6601e340739e7025d543a6a1d4) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.370061 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.371762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.381331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 49/93] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/role_assignments?user.id=39d45c6601e340739e7025d543a6a1d4&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.382651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.423618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.535239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0484f-0462-49ee-a4e3-2bbd6b37c9be None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.577118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.578405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.578879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.579342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.625554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c2c91-4621-4749-bf8d-a6b341bcb1aa None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:17.637272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.680840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.682635 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.723863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:17.724565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:17.724860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:17.725144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:17.726010 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:17.726336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:17.727876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:17.736305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:17.739691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 45/94] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 259 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:17.823050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 50/95] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:17.828837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:17.959177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f2d91-ec13-4b63-a7aa-6b44cd34e298 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.013208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.014119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.014407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.014708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] PATH_INFO: `/v3/projects/abf74db371de434caadbeb788af90a97` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.019559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] RBAC: Authorizing `identity:get_project(project_id=abf74db371de434caadbeb788af90a97)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.021075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a888766-4c33-4729-82bf-dd0d15f3190c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.023012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 46/96] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:17 2022] GET /identity/v3/projects/abf74db371de434caadbeb788af90a97 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:18.029020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:18.148876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67f5c-9485-4805-9556-79aea51c0562 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:18.184056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:18.190167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:18.191345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:18.191886 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:18.192532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:18.193790 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=abf74db371de434caadbeb788af90a97, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:18.194114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:18.195622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7e98-5d61-478e-957c-80020edd1179 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:18.202510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 51/97] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:18 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=abf74db371de434caadbeb788af90a97&role.id=6b1caefc1f754ef995ff5f010637468d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:19.698024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8c1b-ca73-41bd-a4ad-4ff44cd026ce None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.698528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8c1b-ca73-41bd-a4ad-4ff44cd026ce None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.698599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8c1b-ca73-41bd-a4ad-4ff44cd026ce None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.700118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 47/98] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:19.705484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:19.705873 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:19.706048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:19.727692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:19.728895 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:19.813188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 52/99] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:19.849383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de8c1b-ca73-41bd-a4ad-4ff44cd026ce None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:19.900393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:19.984049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de8c1b-ca73-41bd-a4ad-4ff44cd026ce None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.028560 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.029397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.029686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.029968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.051943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:20.059935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:20.060956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:20.061722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 48/100] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:20.068987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.197563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45368f-6bee-4b2a-b0aa-522ee898be63 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.227081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.245851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.246459 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.246774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.247064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.247839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:20.248156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.249559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.258583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 53/101] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:20.267869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.386303 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.392621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b91d-a8bf-460c-bb43-9a70a37ca5c3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.439972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.441312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.441857 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.442356 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] PATH_INFO: `/v3/users/7494e220b3084caba72ddc7bc8e8d182` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.466541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] RBAC: Authorizing `identity:get_user(user_id=7494e220b3084caba72ddc7bc8e8d182)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.468430 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943ee38-50ef-417e-9d86-3205853cabdc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.470821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 49/102] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/users/7494e220b3084caba72ddc7bc8e8d182 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:20.476667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.528452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535aeca-0145-4e3d-ac2a-030e099314e9 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.529052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535aeca-0145-4e3d-ac2a-030e099314e9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.529522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535aeca-0145-4e3d-ac2a-030e099314e9 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.531361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 50/103] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:20.536632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57957c-4538-4028-a14e-a5cbff5bcffd None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.537165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57957c-4538-4028-a14e-a5cbff5bcffd None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.537675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57957c-4538-4028-a14e-a5cbff5bcffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.571660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-7b57957c-4538-4028-a14e-a5cbff5bcffd None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:20.573195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-7b57957c-4538-4028-a14e-a5cbff5bcffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:20.613722 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd40d8a-c6f4-474f-a1a4-d07b4d88a280 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:20.699701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:20.700773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.701206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.701658 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.733424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 51/104] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:20.735367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c66fe-5b8c-4eb0-b81e-e7df6fddbf63 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.735794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c66fe-5b8c-4eb0-b81e-e7df6fddbf63 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.736325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c66fe-5b8c-4eb0-b81e-e7df6fddbf63 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.737723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 52/105] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:20.739085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c9ec-77d4-46e1-9e02-9196d5230484 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.739521 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c9ec-77d4-46e1-9e02-9196d5230484 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.739931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038c9ec-77d4-46e1-9e02-9196d5230484 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.741257 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 53/106] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:20.743833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e7c6-60cf-407f-ab7d-df3deccd8374 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.744320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e7c6-60cf-407f-ab7d-df3deccd8374 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.744870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49e7c6-60cf-407f-ab7d-df3deccd8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.762083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-9d49e7c6-60cf-407f-ab7d-df3deccd8374 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:20.763654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-9d49e7c6-60cf-407f-ab7d-df3deccd8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:20.775199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.793808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:20.795815 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:20.845821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 54/107] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:20.850989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:20.851493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:20.851961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:20.880575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:20.881786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:20.894741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:20.931016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 54/108] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:20.935963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:20.965154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 55/109] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:20.966400 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.047628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.068581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03163e8-1335-4a5c-a268-9147588aa845 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.077779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a218-fdb8-4f8e-be71-cc6fede38741 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.116929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.118247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.118382 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.118934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.119218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.119512 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.119803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.119914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.121750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.123515 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.125509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 55/110] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.126785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.134266 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:21.144639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:21.145564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:21.146341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:21.151066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 56/111] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:21.153478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.158383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.246054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58b87-c5f1-45d3-b217-94256244a4a4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.286515 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.287485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.287825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.288103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.289213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac316e3d-4881-4008-ab74-47d9275c3f5a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.289488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.291202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.298869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 56/112] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.299355 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.327579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.332281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.333112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.333401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.333686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.344460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:21.352403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:21.353271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:21.354030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 57/113] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:21.355336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.412692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e40dde-79cf-4945-9306-407c3ba1258e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.428253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.450535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.451523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.451800 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.452518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.453969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.468677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c21e9-a137-4254-828c-990912d7e6b2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.479775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 57/114] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:21.480452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.506491 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.507218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.507504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.507786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.508566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.508883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.510445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca2a5-f236-475d-aad3-5a63a932377f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.524897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 58/115] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.524897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafa15-c540-4c4f-a179-37600a715d9b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.524897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafa15-c540-4c4f-a179-37600a715d9b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.524897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafa15-c540-4c4f-a179-37600a715d9b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.524897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 59/116] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:21.525329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafa15-c540-4c4f-a179-37600a715d9b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.576712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.608497 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1404de-e1f5-4595-aa10-eb93040cab52 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.640627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafa15-c540-4c4f-a179-37600a715d9b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.652687 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.653639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.654121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.654618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.655715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=7494e220b3084caba72ddc7bc8e8d182) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.656367 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.658203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1cdbb-99f0-45c1-9f8d-f97b75c80b75 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.664987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 58/117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/role_assignments?user.id=7494e220b3084caba72ddc7bc8e8d182&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=a9dff259f54542d4b590e5db0138327d => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.666614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35bf4-d91d-4172-9426-844e317f5362 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.666943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35bf4-d91d-4172-9426-844e317f5362 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.667279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35bf4-d91d-4172-9426-844e317f5362 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.668735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 59/118] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:21.669311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a35bf4-d91d-4172-9426-844e317f5362 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.681312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.695068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.696124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.696606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.697075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.698100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:21.698620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.700331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb40ab-ee33-440a-85d9-a945c4c66621 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.711632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 60/119] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.713297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07954-9e2d-4be6-8930-958665994205 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.713789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07954-9e2d-4be6-8930-958665994205 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.714280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a07954-9e2d-4be6-8930-958665994205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.733859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-66a07954-9e2d-4be6-8930-958665994205 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:21.735202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-66a07954-9e2d-4be6-8930-958665994205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:21.815199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 61/120] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:21.816721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.817022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.817307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.827289 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a35bf4-d91d-4172-9426-844e317f5362 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:21.835603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:21.836829 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:21.875708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:21.876700 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:21.876991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:21.877272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:21.879682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:21.881261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:21.883295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 60/121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:21.887205 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.900208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:21.919708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 62/122] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:21.923572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:21.990286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.026097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d8636-7a40-405c-92c3-b4b1dce4e1a4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.062069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.062864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4ca7f-59f1-4d89-b925-c297a7ea96be None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.063095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.063390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.063672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.065435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.066996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.068648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 61/123] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.069423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.109063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.110069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.110358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.110634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.128163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:22.137135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:22.138199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:22.139144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:22.141261 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 63/124] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:22.142455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.167576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.197814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e366-21f4-4ea3-9c08-037279f33f2a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.233519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.234247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.234531 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.234860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.236158 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.237696 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.239614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 62/125] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.240385 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.278505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e95-9b63-4339-93d9-1fbe8d054789 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.290809 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.325849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.327370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.327822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.328509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.341931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:22.349871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:22.351072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 64/126] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:22.351968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.362413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d436ac1-8a91-48b9-afa1-99916e95e3cc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.409007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.410816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.411268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.412051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.413682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.416203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.419320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 63/127] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.420954 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.437214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.462173 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab486d8-0d23-4c20-b8bc-9a38cecc073a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.497289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.498162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.498348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.498634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.499421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:22.499733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.501283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.517399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 65/128] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.517399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.547227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.565544 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba049-913b-4d07-97c4-5050f208c722 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.611248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.613079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.613519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.614209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.617323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, user_id=f30057d164aa4fa2abc8c559f0cda5e6, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.619523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.624250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25947c-9e4f-410d-b320-da63a07e3838 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.635029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 64/129] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:22 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:22.635866 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.675551 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.676906 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.677517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.678014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.679102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:22.679640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.681331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.700532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 66/130] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.707815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.729589 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.762091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee7b6c-6bf8-472c-a22f-840a12211ef7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.803325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.804693 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.805010 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.806990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/users/39d45c6601e340739e7025d543a6a1d4/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.812927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, user_id=39d45c6601e340739e7025d543a6a1d4, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.816286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.845023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 65/131] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:22 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/users/39d45c6601e340739e7025d543a6a1d4/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:22.845933 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:22.895216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:22.911312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9618d-c3ba-4a12-8cce-cdc3d0dd8f03 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:22.977090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:22.977995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:22.978279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:22.978557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:22.981588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:22.983110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:22.985058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 67/132] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:22.999853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.060397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1f534-4bb8-47e7-af59-f09bc56f25ca None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.114080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.126038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.127615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.127916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.128199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.129645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.131386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.133570 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 66/133] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.140997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.175419 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a32e-d985-42e9-b395-a4b20ec55591 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.223362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.225108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.225396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.225675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.227057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.228531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.231082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 68/134] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:22 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.237625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.256831 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d319cf3-680c-4cdc-acd7-a979dc170910 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.278012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.297659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.299529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.300011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.300451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] PATH_INFO: `/v3/projects/abf74db371de434caadbeb788af90a97` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.302154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] RBAC: Authorizing `identity:get_project(project_id=abf74db371de434caadbeb788af90a97)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.304063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.306014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 67/135] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:23 2022] GET /identity/v3/projects/abf74db371de434caadbeb788af90a97 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:23.311734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:23.361880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5622-5f51-48c6-b91d-447e624e5d5d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.403280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.404713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.404997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.405274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.408174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, user_id=f30057d164aa4fa2abc8c559f0cda5e6, role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.410250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f64828-36dc-4e1b-8b82-28d34e39d70d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.432409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:23.438788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 69/136] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:23 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/f4e416d654c94fa4b1fa935222bca067 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:23.500883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684719a-8c5f-48a6-abd6-fe45ee422452 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:23.556360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:23.557308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:23.557601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:23.557885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] PATH_INFO: `/v3/projects/abf74db371de434caadbeb788af90a97/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:23.559949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] RBAC: Authorizing `identity:create_grant(project_id=abf74db371de434caadbeb788af90a97, user_id=f30057d164aa4fa2abc8c559f0cda5e6, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:23.561484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310af93-6fa6-4287-b077-c22435d7ff56 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:23.588121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 68/137] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:23 2022] PUT /identity/v3/projects/abf74db371de434caadbeb788af90a97/users/f30057d164aa4fa2abc8c559f0cda5e6/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:24.218181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a95ba-19c0-4a21-9d82-ff75fcaa189b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.219282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a95ba-19c0-4a21-9d82-ff75fcaa189b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.219781 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a95ba-19c0-4a21-9d82-ff75fcaa189b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.221496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 70/138] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:24.227349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5301e-1ec1-4d44-9400-ad6bc981f6df None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.228250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5301e-1ec1-4d44-9400-ad6bc981f6df None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.228761 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5301e-1ec1-4d44-9400-ad6bc981f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.250558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-07e5301e-1ec1-4d44-9400-ad6bc981f6df None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:24.252222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-07e5301e-1ec1-4d44-9400-ad6bc981f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:24.339963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 69/139] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:24.374913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a95ba-19c0-4a21-9d82-ff75fcaa189b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.495936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.515372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a95ba-19c0-4a21-9d82-ff75fcaa189b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.527396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0541f5-859c-401a-b547-11d8604b949d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.528008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0541f5-859c-401a-b547-11d8604b949d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.528535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0541f5-859c-401a-b547-11d8604b949d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.530127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 70/140] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:24.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.538592 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.539097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.561725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.562552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.562867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.563150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.579775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:24.581321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:24.585599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:24.593369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:24.594214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:24.594999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:24.602711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 71/141] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:24.602711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.703272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.730368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 71/142] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:24.778821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.805871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c1117-b7a3-4bdd-9e32-0134dbc5ca6b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:24.863535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:24.864371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:24.864624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:24.864914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:24.865675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:24.865987 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:24.870713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:24.891213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 72/143] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:24.891213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:24.911108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:24.939951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea636d70-f4f9-4390-96ce-442428e0344f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.011432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.012637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.013123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.013597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.015074 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.016754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.019065 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 72/144] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:25.031966 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.043417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c310-0709-4505-9c49-ceaebd412647 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.100287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.101194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.101480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.101810 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] PATH_INFO: `/v3/users/7494e220b3084caba72ddc7bc8e8d182` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.103087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] RBAC: Authorizing `identity:get_user(user_id=7494e220b3084caba72ddc7bc8e8d182)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.104537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.114708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 73/145] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:24 2022] GET /identity/v3/users/7494e220b3084caba72ddc7bc8e8d182 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.114708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.144766 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.243082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:25.256756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17f4ed-e336-4dd8-8784-e59c34525227 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.282534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923b6c4-555f-4b8f-beb2-005733856d0e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.348334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.349419 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.349914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.350417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.351390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.353076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b29a-c9b7-43b0-a92d-80278919ba1e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.366742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.366742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.366742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.367058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.371482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.372976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.375326 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 74/146] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:25 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:25.381888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:25.392875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 73/147] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:25 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:25.531223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7d29f-fe35-4c87-ab14-a2835d14b054 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:25.579548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:25.580393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:25.580682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:25.580976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/users/7494e220b3084caba72ddc7bc8e8d182/roles/a9dff259f54542d4b590e5db0138327d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:25.583139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, user_id=7494e220b3084caba72ddc7bc8e8d182, role_id=a9dff259f54542d4b590e5db0138327d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:25.584638 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476836d3-a415-4af6-92b4-ea1f3830cc71 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:25.610464 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 75/148] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:25 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/users/7494e220b3084caba72ddc7bc8e8d182/roles/a9dff259f54542d4b590e5db0138327d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:26.070462 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21706b-e58f-4005-8ea7-871f2fe0a1ec None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.070860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21706b-e58f-4005-8ea7-871f2fe0a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.071067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21706b-e58f-4005-8ea7-871f2fe0a1ec None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.072477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 74/149] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:26.078563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ab81-ed5c-47ab-846d-6ffeb492e9ee None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.079193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ab81-ed5c-47ab-846d-6ffeb492e9ee None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.079600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0ab81-ed5c-47ab-846d-6ffeb492e9ee None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.080520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.080809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.080951 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 76/150] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:26.081333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.086244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.086535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.086850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.101642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.101966 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:26.103214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:26.108053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:26.110885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:26.195266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 75/151] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:26.209042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 77/152] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:26.217985 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.244240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.290437 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.405709 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d54ed-4c6b-42b4-9eeb-8f6420834229 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.420632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4fb3d-3ccd-4d28-b28b-5b4487a3663c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.452298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.453645 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.454040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.454327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.458922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.470600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:26.482950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.483851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:26.484592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 78/153] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:26.491674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.495600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.496436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.496724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.497001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.518313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:26.526259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:26.528409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:26.530435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 76/154] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:26.535588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.678617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6c12-c28b-4f1c-a19d-6583c12784a9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.681814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176c9f-51b4-4b8a-83b6-47b57c21ff39 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.691203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.744490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.746128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.747036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.747322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.747600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.748371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.748683 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.750093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.750908 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.751198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.751526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.752301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:26.752611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.754061 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.769069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 79/155] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.770791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 77/156] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.776391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.777709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.861461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:26.907488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409a-da53-467b-809e-c2fa16c30cf6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.908144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cc168-d620-4823-8447-7876fcbbd69f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:26.944390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.944596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:26.945204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.945304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.945501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.945594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.945778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] PATH_INFO: `/v3/users/39d45c6601e340739e7025d543a6a1d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.945862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.946986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] RBAC: Authorizing `identity:get_user(user_id=39d45c6601e340739e7025d543a6a1d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.947098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:26.948447 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.948561 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfef80c-7de2-4856-be8f-d5c9904fcff4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:26.950403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 78/158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/users/39d45c6601e340739e7025d543a6a1d4 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.950513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 80/158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:26.951670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0badc-ac26-4c53-b903-91181f088e6b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:26.951953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0badc-ac26-4c53-b903-91181f088e6b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:26.952232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0badc-ac26-4c53-b903-91181f088e6b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:26.953439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 79/159] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:26.955979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.959026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0badc-ac26-4c53-b903-91181f088e6b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:26.994409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.063543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569c1e5-f8e2-409a-ae98-cdd8ccf5c8b3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.075001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0badc-ac26-4c53-b903-91181f088e6b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.089989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.100765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.101438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.101725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.101997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.115654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.116323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.116606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.116882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.175656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.177174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709d0c-5329-4fc6-956c-874ca26a0f94 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.192361 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.193846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.226716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.282374 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 81/160] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:27.283629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.283918 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.284196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.305600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:27.306839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:27.308021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 80/161] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:27.308873 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.329806 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.378748 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 82/162] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:27.379659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.432106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdd3eb-04bd-4b72-aaa7-adc63f82b312 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.469276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.483447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.484321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.484604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.484876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.486490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100528ae-73d7-41d8-96e9-d8588b54b8f0 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.488788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.490279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.492038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 81/163] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.492805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.538057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.539055 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.539334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.539607 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.543431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.544974 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.547104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 83/164] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.547981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.585420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.608965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab86d2-9bc1-4b07-bb0b-4530331f2756 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.650524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.650524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.650524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.650524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.662712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:27.669362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:27.670233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:27.671050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 82/165] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:27.671958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.692582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaeac1-469d-41a2-b8ee-5e655a085df8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.738201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.738861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.739151 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.739430 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.740273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:27.740588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.741687 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.742152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07029ff1-2b5e-4a7b-b912-5f9312e12843 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.749061 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 84/166] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=6b1caefc1f754ef995ff5f010637468d => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.750493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c42bd-a6c8-4c08-8b60-d7ad40835008 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.754977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c42bd-a6c8-4c08-8b60-d7ad40835008 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.755340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c42bd-a6c8-4c08-8b60-d7ad40835008 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.756829 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 85/167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:27.757603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c42bd-a6c8-4c08-8b60-d7ad40835008 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:27.792416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56332d6-1dfc-4f16-b954-7aa439ba5711 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:27.843464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:27.844152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.844435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.844714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.845700 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=39d45c6601e340739e7025d543a6a1d4) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:27.846014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:27.847547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18439f-ee42-4637-8b1a-0dc14e19ca7c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:27.863914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 83/168] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/role_assignments?user.id=39d45c6601e340739e7025d543a6a1d4&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:27.865058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:27.865343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:27.865623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:27.908007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:27.909644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:27.930354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:27.961335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c42bd-a6c8-4c08-8b60-d7ad40835008 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.026445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.027089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.027417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.027689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.028466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.028830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.030285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.046251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 86/169] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:28.052286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.068921 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 84/170] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:28.123812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.193785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6523ee6-ed7b-4131-a60c-07ae2f622776 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.235224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.236201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.236479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.236761 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.238585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.240488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.242509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 87/171] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:28.249710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.267437 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.283157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.362112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045b378-ed2f-4ff7-ad1a-0c9ebf62cfc2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.421733 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.422989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.423593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.424068 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.425460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3d82-174f-4cf2-923c-e27631ade101 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.435992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:28.446228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:28.447150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:28.448004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:28.451521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 85/172] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:28.457446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.504432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.505111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.505404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.505688 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.574220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529c20-23db-4891-88c3-bc29c18954eb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.588943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.614934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.616002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.616489 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.616984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.617949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:28.618471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.620259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.631786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 86/173] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:28.637274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.677811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.680777 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.723404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:28.826037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c84692-1d14-4f17-9d23-2104473f3b2a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:28.876706 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:28.877602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:28.877888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:28.878167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] PATH_INFO: `/v3/users/f30057d164aa4fa2abc8c559f0cda5e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:28.879534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] RBAC: Authorizing `identity:get_user(user_id=f30057d164aa4fa2abc8c559f0cda5e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:28.881264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:28.882934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 87/174] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/users/f30057d164aa4fa2abc8c559f0cda5e6 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:28.888841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.892876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 88/175] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:28.898445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:28.948804 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.043736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1f6c-f07c-4011-bcfd-869b7a979fbf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.092901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.093933 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.094419 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.094942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.118441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a097-f7da-457b-b57b-22b499e1d2d2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.153690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.198302 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.199232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.199517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.199795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.201025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:29.202499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:29.208669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 89/176] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:29.218235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:29.247796 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:29.249317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:29.336374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.425216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 88/177] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:29.430850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:29.460640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dc7d8-21b0-4354-98d9-ff19bf0adb5a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.554282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.555317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.555833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.556343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.557429 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:29.557988 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:29.559746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:29.577350 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 90/178] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:29.580836 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f61328-ce4b-4a12-8983-c49cc9dad586 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.631024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.631939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.632223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.632499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] PATH_INFO: `/v3/projects/abf74db371de434caadbeb788af90a97` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.639785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] RBAC: Authorizing `identity:get_project(project_id=abf74db371de434caadbeb788af90a97)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:29.641318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b0084-9867-4122-a0ce-23e81426ae8f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:29.643266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 89/179] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/projects/abf74db371de434caadbeb788af90a97 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:29.649490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:29.760346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b0b7-3a6f-4a7e-9c90-3bd97854d9df None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.760663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b0b7-3a6f-4a7e-9c90-3bd97854d9df None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.760832 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b0b7-3a6f-4a7e-9c90-3bd97854d9df None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.762396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 90/180] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:29.770344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96260-a384-4b26-b762-35d781c44060 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.770658 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96260-a384-4b26-b762-35d781c44060 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.770954 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d96260-a384-4b26-b762-35d781c44060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.771377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.802077 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-22d96260-a384-4b26-b762-35d781c44060 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:29.803371 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-22d96260-a384-4b26-b762-35d781c44060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:29.806860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:29.862066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8c0a-fbda-45ec-885a-96d5fb9258d6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:29.884243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 91/181] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:29.917510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:29.918217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:29.918504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:29.918808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:29.919689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=abf74db371de434caadbeb788af90a97, user.id=f30057d164aa4fa2abc8c559f0cda5e6) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:29.920012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:29.921602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a505f33-a6fb-4da7-a4d1-571d4662c8ca None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:29.931792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 91/182] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/role_assignments?user.id=f30057d164aa4fa2abc8c559f0cda5e6&scope.project.id=abf74db371de434caadbeb788af90a97&role.id=6b1caefc1f754ef995ff5f010637468d => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:29.934014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96260-a384-4b26-b762-35d781c44060 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.001936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ebda-04f7-4c4a-9cc2-95794745fec5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.002294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ebda-04f7-4c4a-9cc2-95794745fec5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.002496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6ebda-04f7-4c4a-9cc2-95794745fec5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.004125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 92/183] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:30.010968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.011553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.012059 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.033490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:30.035089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:30.070666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d96260-a384-4b26-b762-35d781c44060 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.117049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.118224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.118782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.119198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.130155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.142721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:30.150106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:30.151086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:30.151874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:30.155303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 92/184] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:30.162188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.168078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 93/185] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:30.228286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.301484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f80d48-7361-4735-a9fc-3222a78a9ba5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.309889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.350164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.350907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.351198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.351481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.352256 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:30.352571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.354636 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.368266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 93/186] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:30.374632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.392168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b239b-09de-4929-99ad-9e3d849632bc None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.433959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.435295 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.435791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.436298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.449495 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.456275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:30.464852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:30.466334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:30.468137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:30.471004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 94/187] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:30.477113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.506167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8415ad5-862a-464e-b06a-f8d620dd044c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.554564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.556401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.556691 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.556972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] PATH_INFO: `/v3/users/7494e220b3084caba72ddc7bc8e8d182` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.558910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] RBAC: Authorizing `identity:get_user(user_id=7494e220b3084caba72ddc7bc8e8d182)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.560425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.562273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 94/188] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/users/7494e220b3084caba72ddc7bc8e8d182 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:30.567937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.603011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8ddc-a013-4f88-a977-87dc9d009f99 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.605375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.640099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.640824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.641060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.641341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.642168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:30.642482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.643936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695a5c-9627-4c23-8b10-94d5cd991b98 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.662255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 95/189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:30.662255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c955b4d-e2bb-4218-85a5-d854391a7a97 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.662255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c955b4d-e2bb-4218-85a5-d854391a7a97 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.662255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c955b4d-e2bb-4218-85a5-d854391a7a97 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.662255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 96/190] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:30.662648 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b3fb-764e-44de-b59e-8729d09c9d47 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.662763 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b3fb-764e-44de-b59e-8729d09c9d47 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.663240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7b3fb-764e-44de-b59e-8729d09c9d47 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.664386 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 97/191] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:30.665044 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b3fb-764e-44de-b59e-8729d09c9d47 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.681788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed495-bf51-4f38-93be-b16eac7b477b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.709268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.716900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.717179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.717475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.769608 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7b3fb-764e-44de-b59e-8729d09c9d47 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:30.785971 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.787493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ee5c6-6b24-4455-8c0b-a5c33205a668 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.803431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:30.804340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.804676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.804905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.817740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:30.819243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8265a3-5502-475a-a4dd-04fb4c803b90 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:30.820910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 98/192] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:30.822083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.822363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.822637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.838081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:30.839334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:30.856752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.887373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 95/193] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:30.888937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:30.889218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:30.889498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:30.906247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:30.907482 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:30.908583 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 99/194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:30.909274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:30.941591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:30.984876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 96/195] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:30.986084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.008411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d5171-07fa-4d29-bd49-9da0d4ad838a None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.041941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.042605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.042917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.043200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.066922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.085869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d1750-1c86-4398-954f-007ccd5b2a9c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.111152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.112691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.120724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.121598 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.121883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.122161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.123350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.124785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.126560 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 97/196] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.127446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.155268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.211260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 100/197] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:31.212112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.237380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbd29-2a50-4865-ad9a-aa69fd894e42 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.266126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.270716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.271550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.271833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.272118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.282229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:31.290272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:31.291236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:31.292016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 98/198] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:31.292870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf4405-e22e-417e-9977-cd53fdae5933 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.347795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.348532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.348817 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.349092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.350280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.351794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.353595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 101/199] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.354262 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.385924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.398634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36481e0-426e-4185-ae04-420a5e2037de None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.432640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.433318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.433623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.433900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.434790 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, scope.project.id=a1de537f489141eaaafa57664e821e93, user.id=7494e220b3084caba72ddc7bc8e8d182) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.435078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.436641 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.442939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 99/200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/role_assignments?user.id=7494e220b3084caba72ddc7bc8e8d182&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=a9dff259f54542d4b590e5db0138327d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.443613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.453052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033b3fe-7891-492d-8c84-672bb397d3de None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.480809 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.497117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.497830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.498116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.498392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.499751 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.501308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.503333 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 102/201] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.503921 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.561005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ed3b-e4df-42e2-a98f-6b794a42b3c5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.599356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.599965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.600246 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.600538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.601388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.601703 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.603203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.616976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 100/202] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.616976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.625711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d083505-8548-40ee-9191-2fce15d3d765 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.631772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.671430 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.672130 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.672420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.673511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.673511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.675831 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.703483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 103/203] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:31 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:31.704468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.745983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e24d06-7a6a-4ac2-a7be-1f818ed099b5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.762609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:31.784956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.785646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.785936 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.786218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.787114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=95144a22fd234558af3fe8c61a4effdd) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:31.787435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.788981 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.796210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 101/204] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/role_assignments?user.id=95144a22fd234558af3fe8c61a4effdd&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.828554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5facfcf-b713-4f28-97be-aae6cc36e1b0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:31.870358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:31.871218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:31.871503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:31.871782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:31.873163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:31.874707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:31.876702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 104/205] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:31.882610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:31.973593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.001523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a6c3a-17f3-464c-9935-884534c3c3f4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.037116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.037716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.038003 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.038282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.114362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.116091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.197781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.226805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 102/206] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:32.229157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.333442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b114-ffed-4ce0-8189-5ef1363d96aa None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.365811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:32.368850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.369837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.370226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.370628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.372056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.373751 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5ea41-ea76-4bd2-b48e-4a64f6edf6fc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.380568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 105/207] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:32.382034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:32.491098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d681dc7-d385-450a-8254-4651bbedf44a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:32.525252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:32.525916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:32.526331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:32.526623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:32.527491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=95144a22fd234558af3fe8c61a4effdd) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:32.527809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:32.529287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91ae59-c8a1-49db-8aff-7f3328816080 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:32.535286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 103/208] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:32 2022] GET /identity/v3/role_assignments?user.id=95144a22fd234558af3fe8c61a4effdd&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.035747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393117-1855-4473-bc97-07e16b5d47ac None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.036724 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393117-1855-4473-bc97-07e16b5d47ac None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.037227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa393117-1855-4473-bc97-07e16b5d47ac None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.039224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 106/209] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:34.044662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589d7b-8e23-47f7-848d-dc04254b8df4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.045602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589d7b-8e23-47f7-848d-dc04254b8df4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.046072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77589d7b-8e23-47f7-848d-dc04254b8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.063197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-77589d7b-8e23-47f7-848d-dc04254b8df4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:34.064802 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-77589d7b-8e23-47f7-848d-dc04254b8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:34.104567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.133536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b2fb-4cc9-41f1-b574-f6f287ad26ba None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.133842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b2fb-4cc9-41f1-b574-f6f287ad26ba None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.134094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b2fb-4cc9-41f1-b574-f6f287ad26ba None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.135707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 107/210] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:34.136758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c66b1-bf71-4a36-9c50-bdd6b8f1eac5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.137042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c66b1-bf71-4a36-9c50-bdd6b8f1eac5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.137314 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c66b1-bf71-4a36-9c50-bdd6b8f1eac5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.138145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 104/211] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:34.142571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 108/212] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:34.143719 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.143843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.144055 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.144188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.144275 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.144344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.161334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:34.162524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:34.162893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:34.164076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:34.231724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 105/213] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:34.232690 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.245024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 109/214] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:34.254838 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.339832 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc6ff-a5eb-42cc-8db1-dfcb6141872d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.341261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.361698 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0367e7-7ceb-4c1b-a911-4f76153df9a1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.377372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.377637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.378499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.378825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.379106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.389837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:34.397783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:34.398660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:34.399507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 106/215] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:34.400151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.402794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.403830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.404117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.404393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.417244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:34.425014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:34.425953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:34.426782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 110/216] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:34.430518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.511070 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b383e-2c27-4791-9625-a9f8e7554154 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.542365 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dce8bc-efc5-495c-99e9-830e2a1b1dad None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.546085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.547090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.547376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.547650 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.549103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.550625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.557232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 107/217] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.557232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.585419 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.586105 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.586397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.586698 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.587489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:34.587809 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.589220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.592707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.597728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 111/218] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.603049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.636647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.672801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0b72-5381-47ce-973e-bf4c88181a8d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.707000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0792fc-949e-4473-a471-c10cfd920936 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.708791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.709594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.709887 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.710171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.710993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:34.711310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.712706 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.726265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 108/219] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.726265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.747054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.747714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.747996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.748276 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.748988 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.750436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.770331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 112/220] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:34.780244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.821829 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.832804 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c95c-568f-4444-ae26-7856f4e3ad8e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.870748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.871062 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:34.871562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.871847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.872121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.873773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.875404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2282-a309-4138-a39a-6ab2dd6884a1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.877554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 109/221] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.878639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2050-d96c-49e5-8ad4-5430abc2055b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.878961 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2050-d96c-49e5-8ad4-5430abc2055b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.879220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab2050-d96c-49e5-8ad4-5430abc2055b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.880644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 110/222] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:34.885555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab2050-d96c-49e5-8ad4-5430abc2055b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:34.888100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa87de-5eb2-4768-9358-59828a169f50 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:34.925458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:34.926367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.926656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.926985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] PATH_INFO: `/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.942149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] RBAC: Authorizing `identity:get_user(user_id=688d8f5162cf4f51a7b65bd6c2d2584c)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:34.943670 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150de21-2479-4c9e-b3be-de3c22b6c627 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:34.949953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 113/223] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:34.949953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:34.949953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:34.949953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:34.965858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:34.967110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:35.013471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab2050-d96c-49e5-8ad4-5430abc2055b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.049972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 114/224] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:35.052067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.057573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.058458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.058774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.059055 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.060248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.061694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.063605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 111/225] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:34 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:35.071116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.108291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.152482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.177476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db84e-ceb2-4778-9f16-4dad42af27f1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.202678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492983c2-5b40-4afc-a49d-5985694c80cd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.224656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.225351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.225632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.225907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.248447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.249969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.250520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.251000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/95144a22fd234558af3fe8c61a4effdd/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.253956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, user_id=95144a22fd234558af3fe8c61a4effdd, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.256301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.273271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 112/226] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:35 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/95144a22fd234558af3fe8c61a4effdd/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:35.275002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.312142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.314439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.447981 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.476637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2d9c-2350-4273-a4e9-060f21b8d56e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.487422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.529614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 115/227] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:35.537979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.542829 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.543672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.543963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.544242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.583333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:35.597168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:35.598080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:35.598917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:35.600296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 113/228] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:35.609432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.696847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341808f-1395-4e42-8182-1687136feb41 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.766843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.767802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.768148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.768423 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.769700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.771205 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.778719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 116/229] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:35.779598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.819198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38b200-f249-407f-a5fc-39c51eea60fd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.868496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.884418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.885117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.885405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.885693 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.886463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:35.886811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.888412 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.909993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 114/230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:35.915367 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:35.928273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4f4d-efd0-46be-a3db-f7dc9f207726 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:35.946781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:35.975873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:35.976907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:35.977409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:35.977878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:35.978934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=688d8f5162cf4f51a7b65bd6c2d2584c) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:35.983931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:35.985679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:35.994995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 117/231] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/role_assignments?user.id=688d8f5162cf4f51a7b65bd6c2d2584c&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=6b1caefc1f754ef995ff5f010637468d => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:36.084162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e0b94-ca99-42e7-ad69-c3b1ac292af5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.122664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.124040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.124538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.125007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.126722 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.128442 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.130742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 115/232] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:35 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:36.136051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.243883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18db12-d4e1-4a0c-9b18-2c82849782fa None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.271083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.285071 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.286329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.286844 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.287316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.288717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.290377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f402f4-ed03-446d-8e7d-2e10ebf38f4e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.292740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 118/233] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:36 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:36.298139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:36.410740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:36.438144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a5193-3aa7-4d98-9368-1cb0d40d3bb1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:36.489229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:36.490526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:36.491025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:36.491510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/95144a22fd234558af3fe8c61a4effdd/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:36.495940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, user_id=95144a22fd234558af3fe8c61a4effdd, role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:36.497617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1cbd-8641-44d9-b280-0c2d7e935678 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:36.526670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 116/234] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:36 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/95144a22fd234558af3fe8c61a4effdd/roles/f4e416d654c94fa4b1fa935222bca067 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:37.388339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8683f-2c90-49d7-907e-69cf71694652 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.388867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8683f-2c90-49d7-907e-69cf71694652 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.388941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8683f-2c90-49d7-907e-69cf71694652 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.390288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 119/235] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:37.396795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.397740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.398221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.420244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:37.421810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:37.496956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 117/236] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:37.521130 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8683f-2c90-49d7-907e-69cf71694652 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.639334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8683f-2c90-49d7-907e-69cf71694652 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.688348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.689223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.689503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.689773 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.695385 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.696858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efdd54-9716-4209-9aec-8ab74992d19c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.698505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 120/237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:37.704173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.728665 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f7e7-22c0-46b6-b79c-156c40879c88 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.728967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f7e7-22c0-46b6-b79c-156c40879c88 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.729221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2f7e7-22c0-46b6-b79c-156c40879c88 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.730595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 121/238] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:37.749223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d617-e237-4461-a757-c92454e82fbb None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.749511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d617-e237-4461-a757-c92454e82fbb None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.749801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d617-e237-4461-a757-c92454e82fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.780482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-e617d617-e237-4461-a757-c92454e82fbb None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:37.781687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-e617d617-e237-4461-a757-c92454e82fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:37.807073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.869548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:37.872546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c558ff3-2bf4-48ba-acbb-41d6feeef57b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:37.918890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 122/239] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:37.938033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d617-e237-4461-a757-c92454e82fbb None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:37.947411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:37.948115 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:37.948409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:37.948699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:37.949469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:37.950957 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfe6ad-2a0d-4f50-afac-9cbaeb75fabf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:37.988649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 118/240] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:37 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:38.034520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf019e6b-2e6d-47d8-9420-f53b45220f6d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.039005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf019e6b-2e6d-47d8-9420-f53b45220f6d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.039362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf019e6b-2e6d-47d8-9420-f53b45220f6d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.041032 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 119/241] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:38.046469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d617-e237-4461-a757-c92454e82fbb None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.046774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.047069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.047351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.084021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:38.085249 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:38.087160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.088177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.088657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.089094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.101908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:38.111353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:38.112502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:38.113483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:38.120700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 123/242] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:38.122420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.163112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.257631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 120/243] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:38.259810 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f76129-8870-4f5f-8d57-cbaacc65119d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.283843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.298322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.299033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.299318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.299597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.300461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:38.300869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.302273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.311510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 124/244] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:38.317429 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.343360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.391866 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278019c-fa93-40e5-b5ea-2aa584f4d1c3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.420313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.425794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a422-57ce-4013-a353-ecae6a75ee0f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.428779 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.429665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.429917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.430196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.441633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:38.449542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:38.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:38.451252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:38.452317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 121/245] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:38.457755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.461825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.462726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.463016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.463289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] PATH_INFO: `/v3/users/8e80a7fc03744684b693505d6bc7cd92` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.478568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e80a7fc03744684b693505d6bc7cd92)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.480078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.486956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 125/246] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/users/8e80a7fc03744684b693505d6bc7cd92 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:38.487802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.576083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b568ed-13fa-4569-b15d-f651bd400bb7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.592971 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.599918 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d678d-9590-4b89-9f47-1ef2d46c5aa0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.625604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.626430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.626918 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.627206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.628295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:38.628613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.630025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.642211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 122/247] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:38.647937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.648616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.648899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.649178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.657738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.681483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.729797 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.732022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6e087-6808-4160-93c4-307c0dacc851 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.774345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c201-927e-4e61-8d77-d90d2563fb9b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:38.810785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:38.811042 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.811141 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.811391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.812619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:38.814132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9808-d86a-4c97-94c8-e61fc1831afc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:38.817093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 123/248] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:38.817302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2070d6c-79ff-4967-9157-ff037628dbc2 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.817594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2070d6c-79ff-4967-9157-ff037628dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.817872 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2070d6c-79ff-4967-9157-ff037628dbc2 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.823285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 124/249] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:38.826585 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2070d6c-79ff-4967-9157-ff037628dbc2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.837839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 126/250] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:38.839437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:38.839862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:38.840273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:38.864563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:38.866651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:38.894529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.926441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:38.955884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 127/251] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:38.957210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:38.985000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2070d6c-79ff-4967-9157-ff037628dbc2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.051579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.052682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.053161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.053624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.127952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.129769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.146452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d0545-0afc-447c-ae55-0bf80dc48183 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.191687 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.218742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.219638 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.220034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.220313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.221524 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.223008 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.224916 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 128/252] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.225517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.286390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 125/253] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:39.294989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.347715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.393966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1b6e6-d4a3-4a80-b967-9b592236c2a9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.432113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.432947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.433231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.433508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.445045 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:39.453201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:39.454110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:39.454990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 129/254] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:39.455635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.482508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd153d4-8b24-40fb-be67-b9f7dfd0cce4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.527525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.528202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.528490 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.528767 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.530063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=8e80a7fc03744684b693505d6bc7cd92) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.530384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.532502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.539671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 126/255] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/role_assignments?user.id=8e80a7fc03744684b693505d6bc7cd92&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=a9dff259f54542d4b590e5db0138327d => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.540751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.555859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.595530 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755965f3-601f-4936-bdcb-4c5007b23e42 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.616250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.681602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe738985-e1e9-4c0f-b8b8-4469b427f825 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.692589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.693508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.693766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.694045 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.695277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.696764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c002d-afcd-4a25-8afc-f5b2a8c0bf93 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.707258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 130/256] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.708767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ea4b-27e3-480e-a3db-ab606c1ba4c5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.709054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ea4b-27e3-480e-a3db-ab606c1ba4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.709329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ea4b-27e3-480e-a3db-ab606c1ba4c5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.710709 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 131/257] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:39.716198 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.716489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.716771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.719255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.719981 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.720265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.720541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.721307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.721616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.723080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.733359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 127/258] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.734124 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.752460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:39.753708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:39.809925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:39.843454 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1472c3-b853-4c2b-a3a1-d46d71b3305f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:39.900431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:39.901170 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:39.901399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:39.901673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:39.901893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 132/259] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:39.902669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=95144a22fd234558af3fe8c61a4effdd) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:39.902813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:39.902993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:39.904457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:39.921169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 128/260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/role_assignments?user.id=95144a22fd234558af3fe8c61a4effdd&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:39.945934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.104426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2e474-69ee-4b55-8c1f-6107ee9a0db5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.156869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5602e67-297d-426d-9f9c-c1f375edd540 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.188070 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.188938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.190518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.191408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.191950 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.197940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.217008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:40.225818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:40.226808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:40.227591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:40.237098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 129/261] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:40.243585 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.256807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.257708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.257989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.258264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] PATH_INFO: `/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.262701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] RBAC: Authorizing `identity:get_user(user_id=688d8f5162cf4f51a7b65bd6c2d2584c)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.262701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.262701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 133/262] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:39 2022] GET /identity/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c => generated 297 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:40.269283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.415425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d861811-4a79-48b2-af31-5437f4fcafc5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.439780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c382-cdf8-4098-a9e1-c519cd229d43 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.487143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.488100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.488387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.488663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.491011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.492478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.494405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 134/263] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:40.501964 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.514699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.515387 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.515676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.515951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.516799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:40.517114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.518523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.533592 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 130/264] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:40.540322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.592747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.654321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbff8e9-a9c4-4521-b548-1d4ca2eeff13 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.673494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.697502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.698793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.699294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.699766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/688d8f5162cf4f51a7b65bd6c2d2584c/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.702060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, user_id=688d8f5162cf4f51a7b65bd6c2d2584c, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.703927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.728436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 135/265] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:40 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/688d8f5162cf4f51a7b65bd6c2d2584c/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:40.745101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f972a96-b1dd-49fd-8170-1f01a1d9f6ba None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.784668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.785990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.786516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.787043 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] PATH_INFO: `/v3/users/95144a22fd234558af3fe8c61a4effdd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:40.788605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] RBAC: Authorizing `identity:get_user(user_id=95144a22fd234558af3fe8c61a4effdd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:40.790274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:40.792610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 131/266] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/users/95144a22fd234558af3fe8c61a4effdd => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:40.799888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:40.916322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dae5a-07e0-4239-a301-73753a70dcdb None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:40.928013 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:40.953852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:40.955076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:40.955595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:40.956485 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.030713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.032274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715925d-4bee-4337-9706-5d2f203f0adc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.136605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 136/267] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:41.143832 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.276631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914dc52-284e-4099-b398-594fbb1494db None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.276826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914dc52-284e-4099-b398-594fbb1494db None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.277091 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914dc52-284e-4099-b398-594fbb1494db None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.278471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 137/268] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:41.278804 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7985c-4367-4c3b-90b8-a633702f4184 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.284024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611460f-6c2a-452c-ba87-583409c110c0 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.284315 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611460f-6c2a-452c-ba87-583409c110c0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.284598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611460f-6c2a-452c-ba87-583409c110c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.304190 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-2611460f-6c2a-452c-ba87-583409c110c0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:41.305516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-2611460f-6c2a-452c-ba87-583409c110c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:41.321994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.323899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.348775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.349662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.349945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.350220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.351417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.353291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.355351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 132/269] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:41.367049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.406233 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 138/270] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:41.407596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a711a3-cd17-4529-a93e-3b342fa01b77 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.407883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a711a3-cd17-4529-a93e-3b342fa01b77 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.408159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a711a3-cd17-4529-a93e-3b342fa01b77 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.409914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 139/271] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:41.415110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.415693 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.416165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.450425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:41.451983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:41.493948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc763-e397-48e1-a6c8-c4552c7065b8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.521329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 140/272] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:41.522790 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.543645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.544238 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.544529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.545190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.545799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=95144a22fd234558af3fe8c61a4effdd) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:41.546120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.547668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.561260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 133/273] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/role_assignments?user.id=95144a22fd234558af3fe8c61a4effdd&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:41.580040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.599195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.638082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b1bc-4cbc-43a6-946d-96a0356468a4 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.681745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.682923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.683405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.683849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.693129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.697473 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:41.706065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:41.707532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:41.708334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:41.711033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 141/274] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:41.717076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.787483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b61a3e-ecf8-47c6-acf1-aad3c864646b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.832837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f7df-b775-4fe8-acd3-49cc97fd6e1a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.848394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.849174 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.849458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.849737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.855444 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.857321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.859072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 134/275] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:41.861568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:41.864726 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.870068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:41.870772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:41.871063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:41.871337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:41.872134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:41.872445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:41.873979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:41.884197 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 142/276] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:41.889377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:41.982922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ef1d0-2fb7-468d-971a-f2bf444a310f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:41.998596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8270c9-c905-4628-b04f-1421882c5c5b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.012140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.028030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.029109 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.029829 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.030498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.031983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.033710 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.043568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.044533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.045084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.045287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] PATH_INFO: `/v3/users/d9610ac5794543268c1b3fceb82bdc74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.060733 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 135/277] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:43:41 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:43:42.064466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9610ac5794543268c1b3fceb82bdc74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.066459 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68796f93-9330-42a3-b37a-96aa319371d7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.070817 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 143/278] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:41 2022] GET /identity/v3/users/d9610ac5794543268c1b3fceb82bdc74 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:42.075402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.189216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a092655-6e05-4c29-8251-407328480e20 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.225633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.226310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.226593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.226895 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.227823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, user.id=d9610ac5794543268c1b3fceb82bdc74, scope.system=all) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:42.228141 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.229638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341c50a-002a-4bc0-a3a8-e6df6527a2d0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.236362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 136/279] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/role_assignments?user.id=d9610ac5794543268c1b3fceb82bdc74&scope.system=all&role.id=6b1caefc1f754ef995ff5f010637468d => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:42.266356 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b144fe-e52f-4c72-a24a-8b7ad3401a93 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.266763 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b144fe-e52f-4c72-a24a-8b7ad3401a93 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.267005 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b144fe-e52f-4c72-a24a-8b7ad3401a93 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.268489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 144/280] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:42.274561 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.274917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.275260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.295092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:42.296670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:42.347256 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.385384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 137/281] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:42.412097 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b144fe-e52f-4c72-a24a-8b7ad3401a93 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.470186 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.524009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b144fe-e52f-4c72-a24a-8b7ad3401a93 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.559675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.560476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.560754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.561029 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.571504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:42.579378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:42.580270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:42.581057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 145/282] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:42.588161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.732496 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782388a-588c-47c6-af08-b3789f555ac1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.774587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.775299 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.775579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.775905 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.776668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:42.777022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.778423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.790236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 138/283] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:42.796090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:42.915927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f565d7-54a3-463f-91d8-a9b6364bdac2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:42.930931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:42.960297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:42.961185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:42.961462 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:42.961735 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] PATH_INFO: `/v3/users/8e80a7fc03744684b693505d6bc7cd92` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:42.963011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8e80a7fc03744684b693505d6bc7cd92)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:42.964569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:42.966196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 146/284] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/users/8e80a7fc03744684b693505d6bc7cd92 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:42.972120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.021521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.111274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a2d2-a3cf-4b77-8e33-b83f2527920c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.150635 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.151528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.151806 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.152076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.153258 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.154718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdae01-0609-485c-bd8e-ea67cb99bdeb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.156402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 139/285] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:42 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:43.162320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.286128 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d470a-2652-4749-aa29-0820108613e3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.333782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.334749 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.335037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.335311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/8e80a7fc03744684b693505d6bc7cd92/roles/a9dff259f54542d4b590e5db0138327d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.337264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, user_id=8e80a7fc03744684b693505d6bc7cd92, role_id=a9dff259f54542d4b590e5db0138327d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:43.338739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9878bb-76c6-4eed-8ee0-fd9d00f6c409 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:43.363344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 147/286] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:43:43 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/users/8e80a7fc03744684b693505d6bc7cd92/roles/a9dff259f54542d4b590e5db0138327d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:43:43.497347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f750-a3b1-4d9d-bd22-643b6ae7c575 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.497730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f750-a3b1-4d9d-bd22-643b6ae7c575 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.497907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f750-a3b1-4d9d-bd22-643b6ae7c575 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.499659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 140/287] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:43.505133 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.505426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.505712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.527334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:43.528611 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:43.570169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.616982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 148/288] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:43.645603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f750-a3b1-4d9d-bd22-643b6ae7c575 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.781606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f750-a3b1-4d9d-bd22-643b6ae7c575 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:43.784182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:43.816386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:43.817200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:43.817485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:43.817762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:43.828618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:43.836374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:43.837270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:43.838071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 141/289] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:43.845253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:43.968484 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f30b3a-0faf-4db3-aeb5-8f7a2110aca5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.010124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.011197 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.011774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.012235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.013177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:44.013672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.015279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.031080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 149/290] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:44.035791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.185300 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812f306-377a-49f5-b3d6-91b22acf7815 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.219968 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.220854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.221140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.221421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] PATH_INFO: `/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.222618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] RBAC: Authorizing `identity:get_user(user_id=688d8f5162cf4f51a7b65bd6c2d2584c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.224099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.225721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 142/291] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/users/688d8f5162cf4f51a7b65bd6c2d2584c => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:44.231683 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.274859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.352264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77933c0e-c0da-4b7c-b16e-dac263d658e5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.390106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.390783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.391067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.391339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.494277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.495741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.530614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.623219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 150/292] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:44.628456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.709330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:44.761647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c917-c694-4c99-af64-900aaa68359a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.808480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:44.809362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.809646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.809922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.811157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:44.812615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673ea66-4df5-4278-8096-55ff69ceb2f9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:44.814349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 143/293] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:44.823842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:44.976018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6de5-8918-4006-8ca4-6a52623bd6de None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:44.987241 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78ee8a-3be1-4a65-b95a-4231d7ac0c67 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.987566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78ee8a-3be1-4a65-b95a-4231d7ac0c67 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.987798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78ee8a-3be1-4a65-b95a-4231d7ac0c67 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:44.989313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 144/294] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:44.998533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d27f-4470-4e77-8a9b-171d631ed000 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:44.998849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d27f-4470-4e77-8a9b-171d631ed000 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:44.999126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d27f-4470-4e77-8a9b-171d631ed000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.012843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.024353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4320d27f-4470-4e77-8a9b-171d631ed000 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:45.027791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4320d27f-4470-4e77-8a9b-171d631ed000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:45.030352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.031044 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.031325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.031606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.032523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=688d8f5162cf4f51a7b65bd6c2d2584c) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:45.032836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.034274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a3ab-0df7-4ec2-8c26-8ccd5a30e98b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.041104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 151/295] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:44 2022] GET /identity/v3/role_assignments?user.id=688d8f5162cf4f51a7b65bd6c2d2584c&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=6b1caefc1f754ef995ff5f010637468d => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.101590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182bac-1b3d-4a8c-88e4-d5e597aa0d99 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.101900 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182bac-1b3d-4a8c-88e4-d5e597aa0d99 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.102136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182bac-1b3d-4a8c-88e4-d5e597aa0d99 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.103559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 152/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:45.112437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d195-f9a9-4e97-9d13-70a02bbafe11 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.112716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d195-f9a9-4e97-9d13-70a02bbafe11 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.112967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49d195-f9a9-4e97-9d13-70a02bbafe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.142670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 145/297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:45.143911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-9d49d195-f9a9-4e97-9d13-70a02bbafe11 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:45.145140 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-9d49d195-f9a9-4e97-9d13-70a02bbafe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:45.169983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c9a46-9761-41c4-b9a0-fb47723721b2 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.170324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c9a46-9761-41c4-b9a0-fb47723721b2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.170602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c9a46-9761-41c4-b9a0-fb47723721b2 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.172011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 146/298] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:45.175781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c9a46-9761-41c4-b9a0-fb47723721b2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.208066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.239728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 153/299] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:45.241098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.241388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.241665 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.261551 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:45.262840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:45.309015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c9a46-9761-41c4-b9a0-fb47723721b2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.345095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 154/300] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:45.345967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.351366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.352179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.352545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.352823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.364202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:45.373200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:45.374133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:45.375447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 147/301] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:45.376180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.405285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.452632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50896360-1c67-42a3-b7d7-517bd67b948c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.479594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.490225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.491070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.491352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.491627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.492670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6050-56d1-40ea-b371-04f9ef010966 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.492794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.494238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.496225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 155/302] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.496674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.533128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.533939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.534225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.534504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.544372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:45.552100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:45.552996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:45.553795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 148/303] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:45.554445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.606710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a3830-52fe-4c65-944a-01cb6986e02a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.627843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.643517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.644399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.644828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.645249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.646338 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:45.646850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.648387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.657048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145de515-9b03-444f-8c0c-d87d5eceeb62 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.664934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 156/304] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.664934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.695749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.696429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.696720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.697002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] PATH_INFO: `/v3/groups` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.697701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.699199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.726718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 149/305] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 19:43:45 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:45.726718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.742503 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:45.798357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6925c-1fa0-42be-ba39-7e5b06a4c3d4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.849032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.849836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.850118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.850394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.851211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:45.851380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc4cc-5149-4c8d-8032-7bcab057deaa None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:45.851525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.852907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.874702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 157/306] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.876569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.895056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:45.895965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:45.896255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:45.896539 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] PATH_INFO: `/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:45.913787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] RBAC: Authorizing `identity:get_user(user_id=f944c25ddaad4a36bc5e8817fabd9bb9)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:45.915407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:45.917665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 150/307] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:45.923613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:45.936256 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:46.008019 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30ac60-de14-4cef-b8a0-df53555ec5f8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:46.010298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:46.044502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af573eb-63b8-4b72-9077-870e9b30b3db None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:46.057926 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:46.059540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.059833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.060120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] PATH_INFO: `/v3/users/d9610ac5794543268c1b3fceb82bdc74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.061824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] RBAC: Authorizing `identity:get_user(user_id=d9610ac5794543268c1b3fceb82bdc74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:46.063738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:46.066078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 158/308] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/users/d9610ac5794543268c1b3fceb82bdc74 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:46.071333 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:46.079988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:46.080680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.080965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.081242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.082069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, user.id=f944c25ddaad4a36bc5e8817fabd9bb9, scope.system=all) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:46.082381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:46.083854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c0da-6711-4e0e-9862-28dfd74357d0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:46.089889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 151/309] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:43:45 2022] GET /identity/v3/role_assignments?user.id=f944c25ddaad4a36bc5e8817fabd9bb9&scope.system=all&role.id=a9dff259f54542d4b590e5db0138327d => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:46.187634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41576e59-6414-403b-a1e5-96518d69a2bd None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:46.203170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:46.235460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:46.236729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.237162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.237632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] PATH_INFO: `/v3/system/users/d9610ac5794543268c1b3fceb82bdc74/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.239507 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d9610ac5794543268c1b3fceb82bdc74, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:46.241164 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718502-838c-4240-bd1d-346dbf48589c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:46.253618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 159/310] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 19:43:46 2022] PUT /identity/v3/system/users/d9610ac5794543268c1b3fceb82bdc74/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:46.415814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d284-bdad-4df1-a750-25652152fd6e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.416271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d284-bdad-4df1-a750-25652152fd6e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.416690 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d284-bdad-4df1-a750-25652152fd6e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.418588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 152/311] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:46.424546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.425039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.425460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.445319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:46.447261 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:46.518026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 160/312] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:46.541131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d284-bdad-4df1-a750-25652152fd6e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:46.649229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714d284-bdad-4df1-a750-25652152fd6e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:46.681311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:46.686323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:46.687164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.687450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.687729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.698973 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:46.706749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:46.707600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:46.708848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 153/313] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:46.713931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:46.815066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940b7e3-74ea-4bb9-8b73-3a9898150e49 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:46.823395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:46.853935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:46.854616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:46.854932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:46.855213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:46.855975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:46.856602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:46.858001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:46.867232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 161/314] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:46.872762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:46.979353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff68878-c71b-4cb4-8cfa-d524e2b9f26c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.014200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.015113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.015399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.015672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] PATH_INFO: `/v3/users/8e80a7fc03744684b693505d6bc7cd92` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.016942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] RBAC: Authorizing `identity:get_user(user_id=8e80a7fc03744684b693505d6bc7cd92)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.018411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.020383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 154/315] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:46 2022] GET /identity/v3/users/8e80a7fc03744684b693505d6bc7cd92 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:47.025594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.135496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75356ba2-e2ab-4e3f-86e8-c3736c1d4b50 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.170563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.171246 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.171535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.171815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.208342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.244072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.245492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.350871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 162/316] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:47.356958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.419438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.465406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c3e4-e7e0-4487-9266-7ea330f03032 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.502555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.503377 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.503660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.503935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.505177 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.506674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce04d3-2c10-4fab-bdc2-c1080d9f3a32 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.508701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 155/317] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:47.514206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:47.583858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:47.618308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6373f-2dc1-4b51-8c23-d2575bd769a5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:47.659604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:47.660275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:47.660559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:47.660833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:47.661674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74, user.id=8e80a7fc03744684b693505d6bc7cd92) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:47.661980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:47.663458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4bfbd-4204-42e6-b001-f7cefffc5fc9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:47.673187 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 163/318] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:43:47 2022] GET /identity/v3/role_assignments?user.id=8e80a7fc03744684b693505d6bc7cd92&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=a9dff259f54542d4b590e5db0138327d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:48.055816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a865-3de3-4080-a2a3-c68d12ff6039 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.056353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a865-3de3-4080-a2a3-c68d12ff6039 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.056353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2a865-3de3-4080-a2a3-c68d12ff6039 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.058026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 156/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:48.063105 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.063603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.063697 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.080572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:48.081930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:48.149460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 164/320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:48.171798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a865-3de3-4080-a2a3-c68d12ff6039 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.291985 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2a865-3de3-4080-a2a3-c68d12ff6039 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.319278 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.329953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.330795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.331088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.331368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.332543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.334024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7ed15-1b19-4f8c-8cd9-e7b8b7152271 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.335880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 157/321] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:48.341350 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.398904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a78d6-2aa8-4998-9ed8-f18b641247fd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.399192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a78d6-2aa8-4998-9ed8-f18b641247fd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.399470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a78d6-2aa8-4998-9ed8-f18b641247fd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.400880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 158/322] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:48.404410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.405726 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.406083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.406395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.424617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:48.425862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:48.449523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e75978-fb96-48e6-8c5e-8bda1036bb7d None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.485700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.486359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.486638 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.486939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] PATH_INFO: `/v3/groups` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.487634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.489312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe03c33-bade-4d7e-bbb5-02a8704c8e55 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.503076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 159/323] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:48.511557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 165/324] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 19:43:48 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:43:48.525428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.618118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfb96-d72f-409d-ad29-0f0576cb85cc None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.618299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfb96-d72f-409d-ad29-0f0576cb85cc None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.618548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfb96-d72f-409d-ad29-0f0576cb85cc None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.619985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 166/325] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:48.625595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.625901 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.626212 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.638928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaf96d-a6be-43b3-9fdf-1b6a0fa68f6a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.645602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:48.647848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:48.675222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.686002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.687396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.688035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.688318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.700643 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:48.708676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:48.709563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:48.713975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 160/326] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:48.719099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.730220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 167/327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:48.753286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.814572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:48.842249 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e4e4c-233c-49df-a6d8-da2d4bcf9ff5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.885570 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.885919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd05a38-e427-4ca5-a608-c20b1524bcfe None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:48.886631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.887094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.887666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.889386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:48.889846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:48.891464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:48.906904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 161/328] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:48.908899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.931707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:48.932768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:48.933054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:48.933327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:48.947971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:48.955954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:48.956859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:48.958051 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 168/329] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:48.963033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:48.974357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:49.047325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88015-1260-4f3f-a66e-cd1b052c5279 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:49.075674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05f44-31de-4cb5-8897-cf92af49375a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:49.092463 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:49.094007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:49.095576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:49.096187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:49.097085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] PATH_INFO: `/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:49.098562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] RBAC: Authorizing `identity:get_user(user_id=f944c25ddaad4a36bc5e8817fabd9bb9)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:49.100531 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:49.106818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 162/330] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:49.109504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:49.120268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:49.120945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:49.121229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:49.121506 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:49.122260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:49.122568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:49.123998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:49.137444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 169/331] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:49.145182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:49.246901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01610c-ba1d-4795-8fd1-f1d5e6baf807 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:49.261451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386d19b-2f07-4db4-9f00-00fe2a054b15 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:49.268439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:49.292872 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:49.294028 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:49.294363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:49.294649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] PATH_INFO: `/v3/system/users/f944c25ddaad4a36bc5e8817fabd9bb9/roles/a9dff259f54542d4b590e5db0138327d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:49.296330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f944c25ddaad4a36bc5e8817fabd9bb9, role_id=a9dff259f54542d4b590e5db0138327d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:49.297922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:49.308418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:49.309436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:49.309772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:49.310080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] PATH_INFO: `/v3/users/d9610ac5794543268c1b3fceb82bdc74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:49.311364 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9610ac5794543268c1b3fceb82bdc74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:49.312753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 163/332] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 19:43:49 2022] PUT /identity/v3/system/users/f944c25ddaad4a36bc5e8817fabd9bb9/roles/a9dff259f54542d4b590e5db0138327d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:49.314952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96219474-b6ad-4ed9-9d9d-8d287376d5b7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:49.317501 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 170/333] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:49 2022] GET /identity/v3/users/d9610ac5794543268c1b3fceb82bdc74 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:49.323910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:49.446816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e89e66-9d2f-4c31-99bb-650281803a83 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:49.485256 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:49.486282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:49.486778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:49.487287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:49.488474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] RBAC: Adding query filter params (role.id=6b1caefc1f754ef995ff5f010637468d, user.id=d9610ac5794543268c1b3fceb82bdc74, scope.system=all) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:49.489029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:49.490764 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0d59-62d8-413c-8e4c-bea3a755f56e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:49.505630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 164/334] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:43:49 2022] GET /identity/v3/role_assignments?user.id=d9610ac5794543268c1b3fceb82bdc74&scope.system=all&role.id=6b1caefc1f754ef995ff5f010637468d => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:51.256717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae3f0-7640-4d08-bbc7-be1d03b1b2f8 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.257835 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae3f0-7640-4d08-bbc7-be1d03b1b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.258322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae3f0-7640-4d08-bbc7-be1d03b1b2f8 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.260185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 171/335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:51.266262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b9b3-9424-4fa9-b9f3-67d99f05e5eb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.267215 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b9b3-9424-4fa9-b9f3-67d99f05e5eb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.267718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b9b3-9424-4fa9-b9f3-67d99f05e5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.287609 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9ce7b9b3-9424-4fa9-b9f3-67d99f05e5eb None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:51.289147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9ce7b9b3-9424-4fa9-b9f3-67d99f05e5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:51.333236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.374805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 165/336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:51.406107 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae3f0-7640-4d08-bbc7-be1d03b1b2f8 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.410837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a010ae-7814-4b85-befd-dbc650a41c82 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.411133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a010ae-7814-4b85-befd-dbc650a41c82 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.411419 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a010ae-7814-4b85-befd-dbc650a41c82 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.412995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 166/337] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:51.421531 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.421718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.421977 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.455765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:51.456991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:51.481377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.567542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 167/338] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:51.604333 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae3f0-7640-4d08-bbc7-be1d03b1b2f8 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.618977 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.680775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.681606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.681889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.682170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.722711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:51.732904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:51.733839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:51.734635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:51.738200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 172/339] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:51.742768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.757738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.770504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19083b-0beb-4b28-920e-017c399ab12a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.815314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.816330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.816526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.816800 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.832851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:51.847025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:51.848519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:51.849849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 168/340] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:51.858412 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.899141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13c57b-a5fa-47ae-9560-99785f152172 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:51.906710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:51.952743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:51.953837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:51.954319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:51.954825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:51.955783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:51.956312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:51.957901 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:51.974902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 173/341] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:51.979890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:51.987509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e55fee-b312-4720-8514-4b7989c69e46 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.035162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.035162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.035162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.035162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.035555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:52.035555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.035555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.046121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 169/342] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:52.051831 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.083319 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.142616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c30bc-24a1-40bf-8d7c-679421a69e75 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.175564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43ea2c-0917-472e-aa54-314eef1c6c8e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.203470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.204559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.205049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.205543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.223098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.223098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.223098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.223098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.282715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.300549 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.301630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.302042 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.303601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.337455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.446601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 174/343] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:43:52.450520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 170/344] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:52.456199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.456335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.589155 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.600090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e00a8-9aaa-4106-ba74-42eda8465142 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.625861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844ce35-c16b-4e65-a163-e76f47fb74d9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.626582 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.643765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.644668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.644953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.645255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.646498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.650036 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.652473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 171/345] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:52.661740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.715479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.716421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.716700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.716971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.723466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.725155 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.727516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 175/346] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:52.735718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.806992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f53c-957b-48eb-9a93-c77ccb619537 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.867766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a4fd-f56b-44f0-acce-468f190eb266 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:52.871889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.872959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.873391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.873811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.884736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.886870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e805c3d-4e37-4b38-9a7d-d4af85e47f81 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.889045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 172/347] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:52.890455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cd87-3732-4a49-8c0e-181bfc55df90 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.890975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cd87-3732-4a49-8c0e-181bfc55df90 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.891461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783cd87-3732-4a49-8c0e-181bfc55df90 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.892863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 173/348] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:52.895565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783cd87-3732-4a49-8c0e-181bfc55df90 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:52.907154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:52.907154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.907154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.907154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.911072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:52.911072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:52.911322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690658-366f-4a05-ba0e-90f1e00b0b5b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:52.914368 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 176/349] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:52.915731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:52.916144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:52.917002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:52.934633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:52.935766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:52.998082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:53.050995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 177/350] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:53.051888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.104381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783cd87-3732-4a49-8c0e-181bfc55df90 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.174165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.174867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.175151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.175429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.176269 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=a1de537f489141eaaafa57664e821e93) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:53.176583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:53.183088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:53.196290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 174/351] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:43:52 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:53.198240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.232078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ecec-1b46-4e0c-8640-427b27328ef1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.277875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:53.294440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.295148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.295430 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.295706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.296567 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=a1de537f489141eaaafa57664e821e93) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:53.296883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:53.298586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decd2ac-c421-43c4-867b-17190d40eb43 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:53.311245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 178/352] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=6b1caefc1f754ef995ff5f010637468d => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:53.353619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0648-f7bd-4060-8e91-80a00876912a None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.353953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0648-f7bd-4060-8e91-80a00876912a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.354175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0648-f7bd-4060-8e91-80a00876912a None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.357610 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 179/353] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:53.362239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.362559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.362910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.380998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:53.382221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:53.415879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5e4a3-3be7-4d1f-8785-b13fcdd60fa3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.443123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:53.462861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 180/354] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:53.483072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.507546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.508384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.508668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.508944 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.548730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:53.556622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:53.557591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:53.558426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 175/355] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:53.563951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.592055 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26629-7f5b-4412-a1d8-236a1e9137e9 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.628293 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:53.633450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.634258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.634544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.634854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.667873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:53.677125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:53.678120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:43:53.678971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:53.682720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 181/356] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:53.686362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.774729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bc4ce-9771-462c-9d7b-78c306b928ba None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.839254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.839940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.840226 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.840505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.841270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:53.841580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:53.843014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:53.860822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 176/357] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:53.865169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.868274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe27-a5a8-4ad9-a574-b1ef5ca76fe9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:53.920083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:53.920845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.921128 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.921406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.922168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:53.922568 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:53.924879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc9407-6fa5-4b90-88aa-5af95d295109 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:53.938026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 182/358] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:53.939510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72fe-bb35-4667-be4e-218800f68d4b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:53.939804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72fe-bb35-4667-be4e-218800f68d4b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:53.940086 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72fe-bb35-4667-be4e-218800f68d4b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:53.941614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 183/359] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:53.944774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d72fe-bb35-4667-be4e-218800f68d4b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:53.954754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.032976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.125857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58abbf-9b64-405b-9fc9-47b3e376b688 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.167917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d72fe-bb35-4667-be4e-218800f68d4b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.226676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.227509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.227805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.228085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.257406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.258314 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.259028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.259028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] PATH_INFO: `/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.262220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f944c25ddaad4a36bc5e8817fabd9bb9)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.263704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ad34-3531-45fd-9a92-5792a9e003e3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.265395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 184/360] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/users/f944c25ddaad4a36bc5e8817fabd9bb9 => generated 293 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:54.266630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675c13-fd5f-4a55-b333-4341e054d974 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.275739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675c13-fd5f-4a55-b333-4341e054d974 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.275739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42675c13-fd5f-4a55-b333-4341e054d974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.296239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-42675c13-fd5f-4a55-b333-4341e054d974 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:54.298721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-42675c13-fd5f-4a55-b333-4341e054d974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:54.331108 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.332622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9114c33-fca0-47f5-a2ed-ab532fb9c4f3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.383748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.392217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 185/361] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:54.394075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312427-ae8a-4cbb-8936-a279f15bc67e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.394418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312427-ae8a-4cbb-8936-a279f15bc67e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.394717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312427-ae8a-4cbb-8936-a279f15bc67e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.396017 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 186/362] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:54.400950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312427-ae8a-4cbb-8936-a279f15bc67e None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.462712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 177/363] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:54.466707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.466707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.466707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.487995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.509973 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:54.511224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:54.549546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312427-ae8a-4cbb-8936-a279f15bc67e None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.611158 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.611884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.614710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.614710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.614710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] RBAC: Adding query filter params (role.id=a9dff259f54542d4b590e5db0138327d, user.id=f944c25ddaad4a36bc5e8817fabd9bb9, scope.system=all) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:54.614710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.615302 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.659343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 178/364] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:54.662724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.662903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 187/365] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/role_assignments?user.id=f944c25ddaad4a36bc5e8817fabd9bb9&scope.system=all&role.id=a9dff259f54542d4b590e5db0138327d => generated 510 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:54.664935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.795203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.804397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99af21-3041-412c-82a6-0524fb6c41c7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.859787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.860670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.860952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.861224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.888174 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:54.892232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fa7e7-6a2e-49d0-b605-5a0ae1ccaeb5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:54.893885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:54.896375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:54.897270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:54.898056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 179/366] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:54.907931 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:54.948940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:54.949815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:54.950104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:54.950381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:54.952172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:54.953671 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:54.959943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 188/367] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:54.960816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.035884 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18864194-f3fb-4a5e-ac11-1fe9c0e23842 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.066051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.069129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba3cb-c1cf-4d2a-a5c7-f488ef22d3e2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.082044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.082908 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.083211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.084748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.098112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:55.107271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:55.108159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:55.109383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 180/368] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:55.110145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.122252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.123414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.123704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.123985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.124782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:55.125096 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.126667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.136244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 189/369] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:55.137258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.170260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.230123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd1751-d24c-4b8a-b5c0-45b9b33e90b6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.249163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d264e1f-8855-47d5-b9ad-ff69b476e1cf None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.273606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.274949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.275240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.275788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.277018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.279035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.281684 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 181/370] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:55.282507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.295291 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.296152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.296445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.296955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.297655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:55.297969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.299641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.308784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 190/371] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:55.309684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.359945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.414420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4ec23-432e-442b-8027-41c8c8429b61 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.427803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.439184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a328c2-7d82-4618-be98-8e45d244f025 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.457575 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.458656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.459044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.459330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.488170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.488855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.489146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.489427 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.490566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:55.490912 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.492391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.506482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 191/372] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=6b1caefc1f754ef995ff5f010637468d => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:55.507620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.556041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.557788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.679315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.704846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78259-bcbd-40f8-9b0b-7ab09fc3ad2c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.775503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.776216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.776465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 182/373] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:55.776587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.776863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.782466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.812306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:55.864539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.866025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.893594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c802948-13e6-45a5-8472-ef5563e30da1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:55.929998 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:55.930919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:55.931208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:55.931488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] PATH_INFO: `/v3/projects/db0d82a958b6447d9133fc3135f67bd6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:55.932784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] RBAC: Authorizing `identity:get_project(project_id=db0d82a958b6447d9133fc3135f67bd6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:55.934353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:55.936466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 183/374] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/projects/db0d82a958b6447d9133fc3135f67bd6 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:55.941964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:55.971187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.024483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 192/375] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:43:56.038072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.059073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0722125-aad7-4553-838f-c7840e635a78 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.096749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.097731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.098024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.098333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] PATH_INFO: `/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.103888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] RBAC: Authorizing `identity:get_group(group_id=db99c65d0b5c46a2a8c129681c29b4cd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.105523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.108071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 184/376] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:55 2022] GET /identity/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.110819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.114805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.171669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43934-b62b-4cff-9639-1590c5c30dfa None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.221509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.222854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.223174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.223455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.227440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.228600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cd302-bba3-4550-83a9-56b05691279e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.231354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 193/377] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:56.232696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b602-75bc-4a5c-93b7-efbbdb46963f None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.232979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b602-75bc-4a5c-93b7-efbbdb46963f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.233255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2b602-75bc-4a5c-93b7-efbbdb46963f None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.235075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 194/378] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:56.239810 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2b602-75bc-4a5c-93b7-efbbdb46963f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.242899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.260666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5036b-f299-46fe-940a-c41f58dcad4d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.299493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.300543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.300898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.301242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.302154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] RBAC: Adding query filter params (group.id=db99c65d0b5c46a2a8c129681c29b4cd, role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=db0d82a958b6447d9133fc3135f67bd6) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.302536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.304125 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887afa8-6b4a-4e16-8830-3d1e0c9791d7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.310898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 185/379] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/role_assignments?group.id=db99c65d0b5c46a2a8c129681c29b4cd&scope.project.id=db0d82a958b6447d9133fc3135f67bd6&role.id=1a189ac8308b420aa77decb136a045a2 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.311914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.312198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.312475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.332481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:56.334227 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:56.373547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2b602-75bc-4a5c-93b7-efbbdb46963f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.406370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.415120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 186/380] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:56.418236 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.418236 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.418236 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.418236 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.419075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.420285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.422318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 195/381] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.429216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.442536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.520576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.541838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e24f2-d299-4987-84a5-32fd01d0f5f4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.550695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989139e-ecfc-47c6-bd8e-d6d4739c7732 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.579598 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.581082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.581590 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.582050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.583113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.583641 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.585340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa0cd-4ce3-406e-940a-bff2235ab750 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.592915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 187/382] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:56.594765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2dcbc-caa7-425f-b163-3ea550d2325e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.595278 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2dcbc-caa7-425f-b163-3ea550d2325e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.595840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2dcbc-caa7-425f-b163-3ea550d2325e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.598155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 188/383] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:56.599460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.600557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.601047 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.601529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.604973 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.605280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.605540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.617635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:56.627845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:56.628839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:43:56.629622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 196/384] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:56.632505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:56.633957 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:56.635113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.711041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.737607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 189/385] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:56.765344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.775060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96231c-302d-4d2f-8cc3-af16f8b445b4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.814063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.814888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.815200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.815580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.816457 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:56.816777 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.818286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.828372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 197/386] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:56.836413 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.860055 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.884828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7378e-4ef6-4951-b088-857ae3d55b22 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.920519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.921735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.922213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.922818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.934201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:56.942528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:56.943593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:56.944378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:56.947083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 190/387] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:43:56.950067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e254b-059a-4db6-8995-a2546828309b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:56.953199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:56.965484 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:56.986574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:56.987703 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:56.988006 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:56.988499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:56.989540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:56.991981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:56.993016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 198/388] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:57.013455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.069996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ebb1-03d1-4707-ab67-426a84e4086c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.111565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.112576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.113809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.114551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.116456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:57.117118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.121723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.127543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.145205 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 191/389] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:57.155155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.220182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f54da9-64df-49ef-b5ac-71495b3b9ab5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.276437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.277330 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.277617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.277898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.283505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.284445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b54045-8232-44a7-a1f2-7be015e732e2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.284999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.287881 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 199/390] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:57.295352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.349118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.351621 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.353337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.353809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.356617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.358554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.361642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 192/391] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:57.370975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.411436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.506714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dbe7-8de1-419d-9824-0a3d9139de78 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.530046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.581035 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.582188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.582618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.583110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/groups/ecca108318374c14a804800d8fca5003/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.587133 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, group_id=ecca108318374c14a804800d8fca5003, role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.589942 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.598586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aef927-382d-4d41-91c8-fd8ba4145b23 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.619863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 200/392] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:43:57 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/groups/ecca108318374c14a804800d8fca5003/roles/f4e416d654c94fa4b1fa935222bca067 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:57.658001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.659208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.659644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.660132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.663694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.666001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbf6a1-c1bb-409a-9f27-d205861d91bc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.668082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 193/393] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:57 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:43:57.674431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:57.802223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f31ae-51dc-4ee3-bde8-b295a17bc0a5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:57.817267 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:57.842321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:57.843539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:57.843999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:57.844471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93/groups/ecca108318374c14a804800d8fca5003/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:57.846596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1de537f489141eaaafa57664e821e93, group_id=ecca108318374c14a804800d8fca5003, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:57.848200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c281a-ef28-43df-a078-931c7f91c827 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:57.870564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 201/394] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:43:57 2022] PUT /identity/v3/projects/a1de537f489141eaaafa57664e821e93/groups/ecca108318374c14a804800d8fca5003/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:58.662850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad865-2124-4145-a408-7b571d15db04 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:58.663376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad865-2124-4145-a408-7b571d15db04 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:58.663453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad865-2124-4145-a408-7b571d15db04 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:58.665042 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 194/395] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:58.670457 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:58.670898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:58.671098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:58.696535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:58.697793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:58.784608 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 202/396] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:58.828220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad865-2124-4145-a408-7b571d15db04 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:58.951545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad865-2124-4145-a408-7b571d15db04 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:58.993723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:58.994535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:58.994850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:58.995133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:58.997079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.015911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:59.024155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:59.025136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:59.025935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 195/397] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:59.035889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.165826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc5402-5724-4184-9e81-3b269aa45247 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.170036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.211583 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.212184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.212475 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.212747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.213510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:43:59.213820 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.215233 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67806909-9f5d-40b6-9b95-96cd56d4da41 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.231472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 203/398] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:59.237214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.239433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae14d-9cbd-463d-928c-4ed65893742e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.239730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae14d-9cbd-463d-928c-4ed65893742e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.240015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae14d-9cbd-463d-928c-4ed65893742e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.241640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 204/399] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:43:59.247627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc6c5-205e-4f3e-a755-0636ca88141a None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.247919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc6c5-205e-4f3e-a755-0636ca88141a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.248263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bc6c5-205e-4f3e-a755-0636ca88141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.270451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-831bc6c5-205e-4f3e-a755-0636ca88141a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:59.272109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-831bc6c5-205e-4f3e-a755-0636ca88141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:59.396310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 205/400] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:43:59.397689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67febf-9bf5-433b-995d-900eb924449b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.397983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67febf-9bf5-433b-995d-900eb924449b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.398261 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67febf-9bf5-433b-995d-900eb924449b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.400279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 206/401] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:43:59.405421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.405717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.405998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.435100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:43:59.437578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:43:59.439561 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a99d1-2eca-46ab-83af-59cbaf5f20f9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.478194 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.479027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.479317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.479599 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.483268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.484724 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.486876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 196/402] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:59.491957 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.531863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 207/403] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:43:59.532827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.565318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.583450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.636460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8aa21-54bf-4a8a-af59-0c3990d573fd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.665094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbcab0-4ae5-47e8-ab24-3367a097904c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.691611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.692434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.692718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.692990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.706997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:59.707930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.709361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.709853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.710332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.711859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.713548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:59.715381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:59.716239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:59.717105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 197/404] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:59.717764 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.718526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 208/405] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:43:59.735785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.849882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.864076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358f18c-b4fb-4701-8ed9-ac355cbb8115 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.870602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798061fa-d930-4e8b-8c5b-3849724cd038 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:43:59.901779 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:43:59.911083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.911991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.912282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.912925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.913707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:43:59.914596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:43:59.914944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:43:59.915223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/groups/ecca108318374c14a804800d8fca5003/roles/6b1caefc1f754ef995ff5f010637468d` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:43:59.917308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, group_id=ecca108318374c14a804800d8fca5003, role_id=6b1caefc1f754ef995ff5f010637468d)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:43:59.919010 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:43:59.926252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:43:59.934543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:43:59.935697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:43:59.936708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:43:59.939077 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 198/406] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:43:59.939213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 209/407] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:43:59 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/groups/ecca108318374c14a804800d8fca5003/roles/6b1caefc1f754ef995ff5f010637468d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:43:59.940118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:43:59.946449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.065700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58cadf-5726-4121-acf3-ebeecc4514f8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.105617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.106859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.110711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.110711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.110711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.110711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.111192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.126241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 210/408] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:00.127727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.147049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.153017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e46148-4004-4085-b1cb-b1db4fab49b2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.238421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.238421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.238773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.239024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.239794 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:00.240108 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.241520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.252859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 199/409] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.259110 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.287366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcc45-489b-4336-a02c-ebc5f338d441 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.317540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.330758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.331987 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.332461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.332950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] PATH_INFO: `/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.334570 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] RBAC: Authorizing `identity:get_group(group_id=db99c65d0b5c46a2a8c129681c29b4cd)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.336388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.338649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 211/410] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:00.345286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.392473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939ff-dc29-4ab4-9869-9be92124af7f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.438827 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.440085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.440601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.441069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.443460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.450162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.452092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 200/411] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.457581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.526611 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.549101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e828f-80ff-4137-8bae-91f063168e23 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.589727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.591014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.593039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.593522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] PATH_INFO: `/v3/projects/db0d82a958b6447d9133fc3135f67bd6` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.596141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=db0d82a958b6447d9133fc3135f67bd6)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.598945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.609470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 212/412] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/projects/db0d82a958b6447d9133fc3135f67bd6 => generated 344 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.629272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.706614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfb167-efa8-4024-b971-91d661382b52 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.735568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.738482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be39e-6a61-413f-9f98-682d6ee4b1b7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:00.784097 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.785300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.785587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.785870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] PATH_INFO: `/v3/projects/db0d82a958b6447d9133fc3135f67bd6/groups/db99c65d0b5c46a2a8c129681c29b4cd/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.790611 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] RBAC: Authorizing `identity:create_grant(project_id=db0d82a958b6447d9133fc3135f67bd6, group_id=db99c65d0b5c46a2a8c129681c29b4cd, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.792844 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26127-4354-4cea-a08b-86a3281c2272 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.799522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:00.800414 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.800697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.800975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.802161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:00.803631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:00.805686 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 201/413] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:00 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:00.813628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:00.831024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 213/414] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:44:00 2022] PUT /identity/v3/projects/db0d82a958b6447d9133fc3135f67bd6/groups/db99c65d0b5c46a2a8c129681c29b4cd/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:00.832620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2fe6-0f5d-4221-ae6c-4619af3436fc None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.832904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2fe6-0f5d-4221-ae6c-4619af3436fc None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.833176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e2fe6-0f5d-4221-ae6c-4619af3436fc None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.834757 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 214/415] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:00.850380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558729-b00a-49f4-89f9-496e4887cd52 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:00.850380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558729-b00a-49f4-89f9-496e4887cd52 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:00.850380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e558729-b00a-49f4-89f9-496e4887cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:00.865546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-6e558729-b00a-49f4-89f9-496e4887cd52 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:00.866799 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-6e558729-b00a-49f4-89f9-496e4887cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:00.870014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:00.970838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e8f8-fd49-4753-8786-fcaa95fe4176 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.006180 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 215/416] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:01.007672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03037-b245-4175-9419-bbc639acf46a None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.007969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03037-b245-4175-9419-bbc639acf46a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.008247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03037-b245-4175-9419-bbc639acf46a None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.009689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 216/417] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:01.015063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.015352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.015635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.018033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.023142 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.023512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.023860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/groups/ecca108318374c14a804800d8fca5003/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.033283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:01.033717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dc0cbe67c6f4c089a7cedaa73658f74, group_id=ecca108318374c14a804800d8fca5003, role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.034493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:01.035386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.052204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 202/418] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:44:00 2022] PUT /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74/groups/ecca108318374c14a804800d8fca5003/roles/f4e416d654c94fa4b1fa935222bca067 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:01.053480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.117220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.126565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 217/419] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:01.162355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.228482 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5adfae-9e9a-435f-ae0f-0961c4491c17 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.277651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.278974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.279477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.280483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.293227 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:01.311204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:01.312143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:01.314131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:01.314768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.314840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 203/420] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:01.318418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.351567 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95609-b5bf-465d-941f-b6026bbc0b91 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.393123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.393949 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.394233 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.394511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.424826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:01.433064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:01.433957 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:01.435255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 218/421] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:01.441653 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.464927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.473795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9377e28-4206-4060-9c49-21a75348fc5f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.555586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926be4-1878-4900-b1fc-b3239ea8ece3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.568170 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.569101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.569568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.569992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.571011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:01.571470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.573024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.592273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 204/422] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:01.599611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.619030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.627915 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.628659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.628948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.629226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.629988 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] RBAC: Adding query filter params (name=member) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:01.630316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.633888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.660208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 219/423] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:01.660208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:01.788743 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd432fd-aed4-4eb0-9f6d-d4b84b5a160b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.845721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fe7c6-ecfd-4aaf-8150-025bec827534 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:01.854271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.854970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.855260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.855537 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.907972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:01.908550 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:01.908843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:01.909123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:01.909958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.953760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:01.955569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:01.987684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:01.997753 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.000008 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.116663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 220/424] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:02.122304 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.145621 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 205/425] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:02.151025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.234323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:02.301255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5928d1-5b05-4410-af43-39191c7ca731 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.302888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:02.319186 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d5602-2951-42df-aa14-790a934efa7f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.363984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.364862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.365145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.365425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.367292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.368745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.371506 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 206/426] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:02.377645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.380668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.381552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.381830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.382103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] PATH_INFO: `/v3/projects/a1de537f489141eaaafa57664e821e93` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.384102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] RBAC: Authorizing `identity:get_project(project_id=a1de537f489141eaaafa57664e821e93)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.385559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.388441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 221/427] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/projects/a1de537f489141eaaafa57664e821e93 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:02.398102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.564350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f70cb-c39e-4fa0-bb08-03a80266f88a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.586368 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493bfa4-de5d-42ec-bdc9-d66446f654ab None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.610748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:02.617080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.618049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.618466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.618869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.620120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.621654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.627637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 207/428] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:02.629824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.647158 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.648050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.648336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.648612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.652245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.653837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.658733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 222/429] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:02.661208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:02.693928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:02.761107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d557a6-3aaf-46bf-a852-fcdca37900af None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.771375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5198-27b0-4c67-868b-a526c9dcc4a7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:02.805219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.805882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.806169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.806445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.807315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=a1de537f489141eaaafa57664e821e93) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:02.807629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.809089 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff86cf-5272-4e60-b7c7-f72a7f60d30c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.809758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:02.810607 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.811163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.811613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.812697 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=a1de537f489141eaaafa57664e821e93) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:02.813245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:02.815002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:02.815567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 208/430] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:02.816882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951442-13ba-432d-ae0e-4df35abb123e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.817173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951442-13ba-432d-ae0e-4df35abb123e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.817453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951442-13ba-432d-ae0e-4df35abb123e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.830736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 209/431] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:02.830736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:02.830736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:02.830736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:02.835504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 223/432] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:44:02 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=a1de537f489141eaaafa57664e821e93&role.id=6b1caefc1f754ef995ff5f010637468d => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:02.861549 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:02.862898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:02.958642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:02.973932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 210/433] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:03.007369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.112384 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.122399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab421b-4cd5-4b18-8c83-134635ad2fd5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:03.165196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:03.166360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.166983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.167484 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.179577 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:03.187864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:03.188816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:44:03.189609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:03.190211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 224/434] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:03.198163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.305544 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac6d41-5522-4cf2-a3e9-0068d6b9e032 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:03.349023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:03.349728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.350019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.350302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.351100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:03.351467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:03.352814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efa04e-f51e-4613-9172-9d1e4984d6fa None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:03.362917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 211/435] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:03.368876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.481386 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca5d19-422d-4394-a870-a5c04afea050 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:03.511327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04fa2-46fa-44a3-8f83-0f9d6c6dec5f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.511613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04fa2-46fa-44a3-8f83-0f9d6c6dec5f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.511892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a04fa2-46fa-44a3-8f83-0f9d6c6dec5f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.513602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 212/436] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:03.520650 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.521033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.521409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.524725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:03.525799 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.526270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.526742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.541250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:03.542552 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:03.552927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.600566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.600893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:03.602405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d057b-9fe2-48b0-add0-530b0ec3650f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:03.622100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 213/437] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:03.644679 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.709625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 225/438] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:03.711420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935754-5a46-4fce-a82b-609e8df2660c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.711784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935754-5a46-4fce-a82b-609e8df2660c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.712143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a935754-5a46-4fce-a82b-609e8df2660c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.713609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 226/439] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:03.715498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a935754-5a46-4fce-a82b-609e8df2660c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.750614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b98a7-1222-4bc1-84dc-e226e541f0cf None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:03.771142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.784505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:03.785299 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.785581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.785851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.796529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-069a2beb-081f-4881-bacb-87556d5d7b81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:03.804550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:03.805910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:03.806720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 214/440] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:03.807393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.807393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.807507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.821275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a935754-5a46-4fce-a82b-609e8df2660c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:03.823318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:03.824476 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:03.857626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:03.858518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:03.858830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:03.859109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:03.860557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:03.863075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:03.864458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:03.865317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 227/441] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:03.865926 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.898798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 215/442] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:03.899658 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:03.981239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb8b4e-d927-4262-a926-4fb11667fec8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.001345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.008156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49d93c-7fea-485f-86b5-fb45bf5eb6f0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.016680 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.017698 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.017985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.018262 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.019353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.019668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.021050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.029054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 228/443] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.029948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.041258 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.042123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.042401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.042673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.043847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.045296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.046923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 216/444] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:03 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.051867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.090394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.130622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7e18-5434-4e41-917f-520a9f9e89a8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.148245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe919bd5-b124-48e5-8937-240bb11c20cb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.162859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.163612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.163899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.164175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.174090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:04.181406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.182086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:04.182216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:04.183253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:04.184060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:04.184657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.184657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.184786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 229/445] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:04.184786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.229588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.255406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.256888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.287832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509abd6-26b1-4fe3-87aa-73b120181a4b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.304967 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.321711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.322370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.322702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.322996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.323837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=6b1caefc1f754ef995ff5f010637468d, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.324144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.325591 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.331911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 230/446] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=6b1caefc1f754ef995ff5f010637468d => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.332880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.367661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 217/447] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:04.373274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.461519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c2dd-b8e6-45d2-9c42-7c2ee012fb44 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.468944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.486134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa0d00-45ac-4e8a-b41b-86b547a6afa4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.498123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.498843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.499128 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.499405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.500176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.500540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.501947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.510746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 231/448] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.516285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.530500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.531449 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.531783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.532079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] PATH_INFO: `/v3/projects/db0d82a958b6447d9133fc3135f67bd6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.533518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] RBAC: Authorizing `identity:get_project(project_id=db0d82a958b6447d9133fc3135f67bd6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.535434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.537206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 218/449] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/projects/db0d82a958b6447d9133fc3135f67bd6 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.543090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.559627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.633509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd137-9770-470d-a0c3-ab0acb8e3a34 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.670235 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d715b-a3ac-4de4-a4e2-becfb54bbe2e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.676474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.677137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.677433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.677709 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.713344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.714142 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.714429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.714751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] PATH_INFO: `/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.718013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] RBAC: Authorizing `identity:get_group(group_id=db99c65d0b5c46a2a8c129681c29b4cd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.720049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.720425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.722823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 219/450] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/groups/db99c65d0b5c46a2a8c129681c29b4cd => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:04.728654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.755910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.757371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.804530 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.825915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cad6a-3053-466b-97c4-09dc2c3f3f47 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:04.853679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 232/451] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:44:04.859477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:04.863812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:04.864466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:04.864751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:04.865027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:04.865859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] RBAC: Adding query filter params (group.id=db99c65d0b5c46a2a8c129681c29b4cd, role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=db0d82a958b6447d9133fc3135f67bd6) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:04.866175 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:04.867651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:04.873369 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 220/452] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/role_assignments?group.id=db99c65d0b5c46a2a8c129681c29b4cd&scope.project.id=db0d82a958b6447d9133fc3135f67bd6&role.id=1a189ac8308b420aa77decb136a045a2 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:04.932067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:04.971232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f337e9-79bd-4efa-bc33-0733348938e2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.008145 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.009036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.009320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.009596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] PATH_INFO: `/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.010909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=7dc0cbe67c6f4c089a7cedaa73658f74)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.012373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.014135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 233/453] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:44:04 2022] GET /identity/v3/projects/7dc0cbe67c6f4c089a7cedaa73658f74 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:05.020334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.123126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab248-d5b5-4bdf-9d1c-d5f8d3670170 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.158249 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.159139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.159424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.159695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] PATH_INFO: `/v3/groups/ecca108318374c14a804800d8fca5003` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.161001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] RBAC: Authorizing `identity:get_group(group_id=ecca108318374c14a804800d8fca5003)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.162472 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54fa3-98a8-493c-966a-940a34ed588d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.164144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 221/454] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/groups/ecca108318374c14a804800d8fca5003 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:05.171154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:05.276272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09ed0c-9588-4b40-9929-85f53a3bfdc9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:05.310762 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:05.311409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:05.311691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:05.311969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:05.312845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] RBAC: Adding query filter params (group.id=ecca108318374c14a804800d8fca5003, role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:05.313165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:05.314608 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57511a2-5515-4120-aa46-0f47afc0c133 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:05.317487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:05.321292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 234/455] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:44:05 2022] GET /identity/v3/role_assignments?group.id=ecca108318374c14a804800d8fca5003&scope.project.id=7dc0cbe67c6f4c089a7cedaa73658f74&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:08.225064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98171798-e2db-404e-9b5a-2a7874d37617 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.226122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98171798-e2db-404e-9b5a-2a7874d37617 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.226631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98171798-e2db-404e-9b5a-2a7874d37617 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.228452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 222/456] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:08.234454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41ddae-8552-4291-8d3c-4a08d781350b None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.235368 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41ddae-8552-4291-8d3c-4a08d781350b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.235869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41ddae-8552-4291-8d3c-4a08d781350b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.263681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-4a41ddae-8552-4291-8d3c-4a08d781350b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:08.265232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-4a41ddae-8552-4291-8d3c-4a08d781350b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:08.349800 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b18f-33ed-46d3-a355-5b573e76b780 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.350122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b18f-33ed-46d3-a355-5b573e76b780 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.350386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b18f-33ed-46d3-a355-5b573e76b780 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.351867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 223/457] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:08.353623 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 235/458] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:08.357191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6107a-0dea-4801-a339-12bf8e802c2f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.357476 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6107a-0dea-4801-a339-12bf8e802c2f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.357751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6107a-0dea-4801-a339-12bf8e802c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb481dc-98de-4456-9d5d-197ec4da2a73 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.371992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb481dc-98de-4456-9d5d-197ec4da2a73 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.372473 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb481dc-98de-4456-9d5d-197ec4da2a73 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.374279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 236/459] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:08.381912 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f4c6107a-0dea-4801-a339-12bf8e802c2f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:08.384775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb481dc-98de-4456-9d5d-197ec4da2a73 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.385972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f4c6107a-0dea-4801-a339-12bf8e802c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:08.389330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.454730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 224/460] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:08.456464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.457051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.457574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.474792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:08.476315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:08.510543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb481dc-98de-4456-9d5d-197ec4da2a73 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.548181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.554300 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 225/461] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:08.559191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.563448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.564630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.565114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.565923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.586730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.588543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:08.616758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:08.617681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:08.618522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:08.618522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:08.618522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.618522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:08.621016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 237/462] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:08.627355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.653680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.693920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d52f0e-c363-428a-afa4-e26464f695fa None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.739918 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.740644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.740942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.741211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.748962 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863a558-b01b-4566-9963-f744ea9724a5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.752384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.753857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:08.773478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:08.774342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:08.775218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:08.775218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:08.775218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.775218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:08.775218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 226/463] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:08.775491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.786831 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.787641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.787924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.788203 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.799000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.800477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-542be11e-4c6a-4cc1-997f-cd69e6912264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:08.818981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:08.819961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:08.819961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:08.819961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:08.819961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:08.819961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 238/464] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:08.820905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cfb22-d4f4-4346-b28e-4534251a8c83 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.821200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cfb22-d4f4-4346-b28e-4534251a8c83 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.821471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cfb22-d4f4-4346-b28e-4534251a8c83 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.822984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 239/465] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:08.825185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cfb22-d4f4-4346-b28e-4534251a8c83 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.863243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.885756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925687c-fc9b-4232-92a7-8e390ffb0bad None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.909684 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:08.924876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.925611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.925839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.926114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.927220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:08.927845 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.930237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.936486 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cfb22-d4f4-4346-b28e-4534251a8c83 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:08.948186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 227/466] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:08.948186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:08.977381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:08.978137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.978420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.978717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:08.979434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:08.979738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:08.981408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1fc15-1617-4e23-b4c5-f0e73d501ab8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:08.998129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 240/467] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:08.998129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:08.998129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:08.998129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.012179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:09.013345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:09.057072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9817222-7fa8-4047-9b8c-e630e9b34447 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.082726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 241/468] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:09.082726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.104353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.105390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.106477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.107002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.107288 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.108230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:09.108581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.109991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.128655 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 228/469] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:09.128655 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.169692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.187398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9f392-bfef-4512-84bf-c06a0da9a9d6 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.221346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.222025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.222306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.222582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.223306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.224752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.228507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95ed6-968b-48bd-95f3-38ea8125f8b2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.254814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 242/470] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:09.254814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.279985 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.280776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.281149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.281551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.282355 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.284211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.311451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 229/471] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:09.312406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.364758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.395199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38536db3-8a59-4621-b135-8dedb275e839 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.440574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.443562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.445914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.446558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.447899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.454838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e922f-c3f9-4b38-947e-047838a1540a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.479388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.481717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.514739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.515856 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.516324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.516775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.517684 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.519431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f770-4e41-457a-b1af-f0b3973154e6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:09.532712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:09.533708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:09.534850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:09.534850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:09.534850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:09.534850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:09.534850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 243/472] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:09.541064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.547335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 230/473] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:09.678261 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adb3ae-e609-4793-99a2-7fac88d15a1f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.702150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4c86-6278-435c-acb2-ac860bc79047 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.702504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4c86-6278-435c-acb2-ac860bc79047 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.702792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4c86-6278-435c-acb2-ac860bc79047 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.706424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 231/474] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:09.710208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.710641 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.711066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.715860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.726827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.727771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.728234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.728684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.729432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:09.729744 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.732210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.740178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:09.741453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:09.748708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 244/475] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:09.754634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.830448 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 232/476] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:09.855611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:09.877410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756452c1-50eb-4cae-a883-1c4e5232bf91 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:09.930110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:09.932004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:09.932004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:09.932004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:09.932536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:09.935036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:09.959286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 245/477] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:09.975338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:09.995383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31fd0-7238-42af-91d9-14d6de35896e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:10.037811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:10.038608 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.038927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.039204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.039980 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:10.041500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:10.052500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.sql.core [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:44:10.052500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:44:10.052500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [parameters: {'id': 'eb31e206390646169d005b5c67883df2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:44:10.052500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() May 19 19:44:10.069769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return ref.to_dict() May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:44:10.070865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application yield resource May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise self.value May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application session.commit() May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:44:10.071797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.flush() May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application compat.raise_( May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:44:10.072685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:44:10.073564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:44:10.074397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [parameters: {'id': 'eb31e206390646169d005b5c67883df2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:10.075317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:44:10.076312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:10.077337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 233/478] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:44:09 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:10.083789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:10.175286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:10.224031 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab80b-9f31-4b5d-94d6-43fee6c23467 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:10.263523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:10.264345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.264629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.264904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.275795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-56bd2957-3845-40b8-b02e-10a84c843219 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:10.284101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:10.284994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:10.285804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 246/479] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:10.292829 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:10.411942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668b026-f7f5-4382-a45c-bb19d90c8a5a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:10.454210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:10.454913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:10.455293 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:10.455572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:10.456339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:10.456652 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:10.458043 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ffe4a-4c7e-4c63-9154-4692172692d5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:10.466825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 234/480] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:11.921620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6c7b-0f7c-423a-9dcb-574e506fd385 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:11.922827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6c7b-0f7c-423a-9dcb-574e506fd385 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:11.923377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb6c7b-0f7c-423a-9dcb-574e506fd385 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:11.925438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 247/481] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:11.931148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0715-15c1-41a3-9dbe-9db17536be6a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:11.932143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0715-15c1-41a3-9dbe-9db17536be6a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:11.932646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a0715-15c1-41a3-9dbe-9db17536be6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:11.956110 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c73a0715-15c1-41a3-9dbe-9db17536be6a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:11.957648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c73a0715-15c1-41a3-9dbe-9db17536be6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:11.963750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.059562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 235/482] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:12.094788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb6c7b-0f7c-423a-9dcb-574e506fd385 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.114044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa21e7-3e70-42b1-8e09-a98833fa9062 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.114350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa21e7-3e70-42b1-8e09-a98833fa9062 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.114624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa21e7-3e70-42b1-8e09-a98833fa9062 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.116163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 236/483] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:12.121807 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.122363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.122880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.142144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:12.143838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:12.263322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 237/484] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:12.284325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb6c7b-0f7c-423a-9dcb-574e506fd385 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.294311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.303770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.344599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.345399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.345678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.345999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.362631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:12.371392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:12.372298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:12.373520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 248/485] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:12.379618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.408028 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.445189 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba91c6-9b4f-460d-834f-230372829e78 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.491703 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.492888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.493341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.494133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.507751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:12.512319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab5eef-241b-49ab-9315-8f2faf628666 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-21ad716c-09a3-499c-9827-36fbc3875548 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:12.517657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:12.518855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:12.519763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:12.522332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 238/486] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:12.529358 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfb3-0234-4015-b437-e3ef9d9e0aae None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.529649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfb3-0234-4015-b437-e3ef9d9e0aae None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.529935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cdfb3-0234-4015-b437-e3ef9d9e0aae None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.531403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 239/487] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:12.534851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdfb3-0234-4015-b437-e3ef9d9e0aae None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.568907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.569932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.570441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.571067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.572806 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:12.573346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:12.575007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33515451-3068-4577-ad01-ef1c3e0b26f7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:12.590658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 249/488] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:12.590658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.590658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.590658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.615196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:12.616722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:12.644367 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cdfb3-0234-4015-b437-e3ef9d9e0aae None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.649364 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.687491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.694731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.695424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.695792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.695982 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.696751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:12.697066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:12.698514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:12.707699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 240/489] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:12.708580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.722730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 250/490] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:12.723730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.818957 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907b0b8-660e-4b5b-a9ed-dacb43b857f0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.841884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f72c-0bb1-4c5b-ab4a-45c5e19c0f93 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:12.854548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.855396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.855657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.856250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.867752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:12.869222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:12.877370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:12.878180 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.878469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.878749 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:12.886526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:12.887432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:12.888265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:12.888265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:12.888265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:12.888265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:12.888265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 241/491] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:12.889340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.893889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:12.895448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-87999e6b-3f78-4ebb-8182-b13c20e172f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:12.918381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:12.919487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:12.920316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:12.920316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:12.920316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:12.920316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:12.921999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 251/492] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:12.923392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb5be-d9b8-41bd-ab28-13a76f0055fd None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:12.923678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb5be-d9b8-41bd-ab28-13a76f0055fd None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:12.924039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb5be-d9b8-41bd-ab28-13a76f0055fd None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:12.925370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 252/493] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:12.926050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adb5be-d9b8-41bd-ab28-13a76f0055fd None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:12.941072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:12.941392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.000573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172f47c-920f-4604-b9ac-3bdd1e58e04e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.033480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adb5be-d9b8-41bd-ab28-13a76f0055fd None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.035451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.037027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.037308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.037581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.050735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:13.060565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:13.061428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:13.062202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:13.062956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 242/494] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:13.063620 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.072371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.072992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.073277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.073556 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.074293 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.074603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.076448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509c4cd-3e75-4c69-a62a-a0f5ed4f832b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.089399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 253/495] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.091424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.091914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.092681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.110550 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:13.112020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:13.170638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f96c6-4146-4501-a516-29a405b7c8f0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.174123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.181187 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 254/496] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:13.182030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.184264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.220079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.220759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.221045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.221325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.222056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.222369 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.223797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.237379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 243/497] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.238391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.298470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed099f9b-be84-4707-8f33-a8c3d051a61d None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.337334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.338037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.338346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.338621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.339404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.339716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.341167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.350165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 255/498] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.350294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6c462-f343-40a6-941b-fe820ba79f30 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.351362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.393381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.394208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.394495 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.394831 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.404726 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.406297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:13.424913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:13.425861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:13.426817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 244/499] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:13.427407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.428895 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.464336 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.469271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c386ed-a730-4c93-951c-4a7ee43e70a4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.505355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.506159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.506444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.506909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.517383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:13.525094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:13.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 256/500] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:13.527601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.552368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a59987-3fcd-4016-88e0-aa98ffc2fd8e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.588268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.588982 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.589266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.589527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.596614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.598077 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:13.612559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:13.613528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:13.614436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 245/501] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:13.615036 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.629188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac63655-a36c-4de0-bb2f-a46156c3ee06 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.652121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.663734 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.664533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.664834 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.665108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.675812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.677297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:13.694966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:13.695876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:13.696715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:13.696715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:13.696715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:13.696715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:13.696715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 257/502] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:13.696975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.722441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.739512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8ed79-e921-4913-8c68-788106f8fa4b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.775103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.775780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.776061 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.776331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.777178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.777485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.778960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ff067-6aed-441a-9a3b-0b34b573270e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.798745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69769d25-9fdd-443a-a66f-3ef6b7e43fd6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.817522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 246/503] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.818851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded44b7-3164-48c9-9a93-bbc1f501390e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.819151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded44b7-3164-48c9-9a93-bbc1f501390e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.819440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded44b7-3164-48c9-9a93-bbc1f501390e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.820825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 247/504] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:13.821385 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded44b7-3164-48c9-9a93-bbc1f501390e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.834847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.835527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.835817 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.836096 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.837129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.837244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.838597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.846490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 258/505] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.847308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.891543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.924453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded44b7-3164-48c9-9a93-bbc1f501390e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.952517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cff07-49f8-412e-9d9b-98819eaf2825 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:13.958509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.959219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.959505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.959784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.960625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.960943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.962410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:13.976372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:13.981135 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 248/506] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:13.982354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:13.991362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:13.992034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:13.992322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:13.992626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:13.993346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:13.993657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:13.995072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504044b7-594b-4d08-bb89-6bb6bd214866 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.009014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 259/507] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:14.010402 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.010741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.010967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.031654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:14.032882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:14.089309 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0972c6-68a1-4cac-abbf-0a3a107fb0b9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.105767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 260/508] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:14.106948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.123323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.123983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.124266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.124546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.135054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.188628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.191592 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.193511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.205755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649034a-c318-4276-a849-2f8e5e5f7380 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.240602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.241408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.241686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.241958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.251676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.253144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:14.270318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:14.271210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:14.272065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:14.272065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:14.272065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.272065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:14.272065 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 261/509] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:14.272320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.295148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 249/510] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:14.296231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.354522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.377769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4a16-29cb-44d5-864d-0578de03489b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.397793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.401129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d5ba-f36a-4b12-9927-a720878a2beb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.411495 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.412125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.412421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.412822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.437214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.438073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.438360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.438638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.445506 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.446995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:14.461004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:14.462087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 250/511] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:14.463105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.481091 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.482858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.559286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.560809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05753-337d-4cb6-89ec-12a1b74f852d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.578700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 262/512] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:14.579531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.598075 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.598906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.599189 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.599464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.610014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.611494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:14.628909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:14.629774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:14.630611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:14.630611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:14.630611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.630611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:14.630611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 251/513] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:14.630933 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.644778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.683947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d58d-b6ea-40d8-823f-a58f0a9355ab None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.718701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.719389 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.719676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.719956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.720689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:14.721006 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.722384 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.729426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2beca6-8ca0-42e3-af2d-67831bef9ea0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.738119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 263/514] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:14.738119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.764086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.764988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.765171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.765448 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.775612 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.776009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.777097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:14.794858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:14.795729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:14.796581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:14.796581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:14.796581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.796581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:14.796581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 252/515] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:14.796983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.835490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31a02f-c48f-4a6f-a422-b099a1bb8f3f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.858824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:14.869940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.870541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.870846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.871153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.871986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:14.872281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.873722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.896660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a0af0-be5f-4466-a1c3-2ddab8b4897a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:14.910386 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 264/516] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:14.911245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:14.931450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:14.932246 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:14.932533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:14.932811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:14.943004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:14.944521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:14.961853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:14.963188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 253/517] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:14.964069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.009617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.013813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87581fe3-4017-4883-9313-c90ee778a6ce None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.050228 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.050933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.051217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.051495 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.052230 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:15.052538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.053958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.063422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63c1c5-a7bd-4bb4-b1f4-0656e23d5273 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.065902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 265/518] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:15.070639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.081201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.099113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.099913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.100194 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.100489 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.107595 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.109044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:15.123388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:15.124325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:15.125296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 254/519] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:15.125855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.173736 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0d09b-fbad-4a7f-a98c-9fa12a2a92bb None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.205981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.206646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.206962 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.207241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.207978 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:15.208289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.209679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.221131 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 266/520] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:15.221908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.223558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec6e92-085b-4313-b6c9-28cae0af5670 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.240310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.260293 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.260965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.261252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.261511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.305522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.317599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1611f-8f15-4d42-a089-b69b8354ad43 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.329637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.331152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.351687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.352348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.352633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.352903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.353626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:15.353930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.355325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.367335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 267/521] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:15.368119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.434212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 255/522] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:15.435091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.457585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.478616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efc91b-051f-4309-ba05-4de9ec5ca50e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.509751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.512885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.513573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.513863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.514141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.514881 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.516410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.534151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d47bd-ec34-4c6d-afc3-e3cf204537bb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.535534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 268/523] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:15 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:15.536326 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.579614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.580637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.581667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.582147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.583613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:15.584111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.586384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.609806 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 256/524] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:15.615184 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.651358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0a66-df14-43bb-bc37-8a3764906a7b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.692557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.693270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.693534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.694108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.696366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.702335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.704052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:15.722538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:15.723546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:15.724392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 269/525] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:15.724868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.751305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b2f8c-8763-4dff-806f-7958fd57e48c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.792978 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.793892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.794174 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.794502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.796525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.803553 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.805502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:15.820509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:15.821388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:15.822310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 257/526] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:15.823667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.841628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e983ba-f1a3-413c-a0c2-62551d8487eb None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.878619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.879457 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.879744 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.880021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:15.891562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:15.894174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:15.913719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:15.914621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:15.915523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:15.915523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:15.915523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:15.915523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:15.922015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 270/527] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:15.922015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:15.938762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7892c-9622-407b-a8e9-ec6bc2acdab5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:15.972510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:15.976789 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:15.977480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:15.977746 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:15.977996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.028342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bb55-1b19-4354-b9d6-2d615cbf64f1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.052020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.060755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.062382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.064228 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.064974 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.065258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.065529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.066322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.066629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.068287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.091824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 271/528] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.093656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.167681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 258/529] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:16.168712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.205354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f3a97-0255-4f0b-a9f4-83de6b4c444f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.213120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.242028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.242613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.242924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.243204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.244040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.244356 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.245816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.257303 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 272/530] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.258076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.272887 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.281381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856198b2-ef48-46cf-a801-6a251e8c4f26 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.316334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.317013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.317301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.317582 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.318315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.318714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.320121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.331532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 259/531] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.332396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.369273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556168-69e6-46b8-8502-52eaeaeb9fa8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.407865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.409156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.409582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.409997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.411339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=9ed1f8c70e7148428d64da36b4b4bc22) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.412191 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.414252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.421409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 273/532] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/role_assignments?user.id=9ed1f8c70e7148428d64da36b4b4bc22&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.427143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.443301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77e4a-3849-4717-a6cf-84ea54d31f3d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.473761 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.492471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.493937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.494415 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.495151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.511241 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.513504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:16.538805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:16.539754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:16.540587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:16.540587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:16.540587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:16.540587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:16.542847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 260/533] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:16.543857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.557631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.572048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3b716-0d86-4b7c-b960-aae9afb1822b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.620188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.621126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.621546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.622054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.623183 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.623644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.625391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.631776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 274/534] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.632410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.671986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1e5f2-2d88-438a-9ece-3f9daebe6fd4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.710387 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.712139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.712576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.713237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.723909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.725655 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:16.745292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:16.746347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:16.747250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:16.750578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 261/535] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:16.762108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.763376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.770458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84168d-bee9-4c9f-ad0f-2614922fb266 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:16.810925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:16.811620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:16.812114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:16.812470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:16.816516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:16.816867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:16.818665 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:16.844928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 275/536] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:16.850161 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:16.916112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:16.982075 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0cc25-978a-48b0-a92f-dd5d3f12324a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.018872 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faed61e-c56c-41a2-90d8-29b99d2f50ac None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.043782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.044484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.044763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.045035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.045835 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:17.046148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.047703 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.077642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.078618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.078966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.079239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.088787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 262/537] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:17.089876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.091366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.094110 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:17.119323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:17.120234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:17.121077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:17.128786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 276/538] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:17.130482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.159083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:17.269335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187507f-8c8b-4ebd-811a-45000aa40d19 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.290371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36b2d3-af43-42e3-ac82-4d1c54c1dc37 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.296936 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:17.314212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.314911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.315201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.315485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.316342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=a86f4c6ca15e47729dfffe6fcf2c5c34) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:17.316661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.318128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.332102 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 263/539] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:17 2022] GET /identity/v3/role_assignments?user.id=a86f4c6ca15e47729dfffe6fcf2c5c34&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:17.351338 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.352040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.352329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.352609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.353437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:17.353754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.355311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb600692-ac7b-4747-9d36-9bf20645881b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.378135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 277/540] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:17.384172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:17.517938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b221-a1f0-4242-b7c6-74ca3425b1ac None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:17.553851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:17.554443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.554760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.555051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.555901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=cd09cd3eee934b22b8b3cad100e8f930) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:17.556223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:17.557738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2f854-05a1-4b5c-91a9-3a3d967f1e0a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:17.564692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 264/541] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:17 2022] GET /identity/v3/role_assignments?user.id=cd09cd3eee934b22b8b3cad100e8f930&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:17.918115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcc4d-b194-40ab-bb22-5b7c750875df None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.918619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcc4d-b194-40ab-bb22-5b7c750875df None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.919041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fcc4d-b194-40ab-bb22-5b7c750875df None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.920764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 278/542] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:17.926301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:17.926601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:17.926928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:17.945142 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:17.946338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:18.001122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:18.020090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 265/543] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:18.043355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fcc4d-b194-40ab-bb22-5b7c750875df None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:18.125965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:18.160187 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fcc4d-b194-40ab-bb22-5b7c750875df None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:18.202448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:18.203246 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:18.203532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:18.203812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:18.214441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:18.222455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:18.223366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:18.224579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 279/544] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:18.229881 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:18.330099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffc712-924d-4f10-8a4d-c2405f0de8e4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:18.365546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:18.366225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:18.366513 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:18.366824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:18.367647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:18.367964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:18.369366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:18.377892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 266/545] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:18.383375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:18.520802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd360ba-b92c-46ef-b0ae-e67892470e4d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:18.568450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:18.569256 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:18.569535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:18.569807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:18.576147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:18.588623 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:18.590102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:18.612461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:18.615405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:18.616247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:18.616247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:18.616247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:18.616247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:18.616247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 280/546] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:18.619370 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:18.701700 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:18.773817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4b1bc-e596-4ced-920f-b9756c4844f2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:18.819465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:18.820502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:18.820983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:18.821491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:18.822511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:18.823044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:18.824659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:18.841183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 267/547] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:18.845669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:18.995772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9bf34-92fc-42ad-985c-79e447c78461 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.041281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.042003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.042331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.042606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.050870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.052339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-ce84155d-c0dc-438d-a892-3d8261e06fd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:19.068025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:19.069357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:19.071022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 281/548] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:19.074847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.109032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c854-8eee-42d1-ae17-a4fe2b0c557e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.109032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c854-8eee-42d1-ae17-a4fe2b0c557e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.109032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c854-8eee-42d1-ae17-a4fe2b0c557e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.109784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 282/549] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:19.115670 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.116182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.116603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.134611 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:19.136545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:19.180309 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.210783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 283/550] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:19.227306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.301402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc971e4-4332-4be3-9e85-b85a7dcc8e55 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.311809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.343934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.345237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.345727 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.346466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.347813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:19.348344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.350660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea535-9a68-4fda-9f27-a89858dde322 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.371418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c162d-8fa2-4674-80da-19f766dd32b1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.372857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 268/551] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:19.374534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49eed1-99bc-4847-9eb2-ef5b141c2d43 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.375442 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49eed1-99bc-4847-9eb2-ef5b141c2d43 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.375894 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49eed1-99bc-4847-9eb2-ef5b141c2d43 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.377662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 269/552] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:19.378838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49eed1-99bc-4847-9eb2-ef5b141c2d43 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.421261 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.422455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.422898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.423477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.438843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-8db0c005-5181-4d41-ac3b-7a4f6b2ca902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:19.448076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:19.449201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:19.450032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:19.451199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 284/553] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:19.454360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.454360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.454360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.474388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:19.477209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:19.520801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.526529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49eed1-99bc-4847-9eb2-ef5b141c2d43 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.576157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.576441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 285/554] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:19.576890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.577233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.577378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.577625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.616067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.660148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.670727 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.716222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62defdc-6fc9-49b3-b93f-18a61c6e9791 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.762856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.763902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.764183 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.764455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.765201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:19.765647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.767794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.780841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 270/556] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:19.783947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 286/556] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:19.784886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.786171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.827984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.875679 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:19.908106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f0b78-0646-4b05-947c-d6cc57b9dcd5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.936051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c2a51-687d-4b81-8f8a-4a4d3ddd52ed None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:19.945674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.946491 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.946823 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.947103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:19.958930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:19.960354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:19.978496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:19.979446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:19.981421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:19.981421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:19.981421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:19.981421 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:19.984986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:19.985717 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 287/557] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:19.986444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:19.986870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:19.987349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:19.987811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.007277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:20.018434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.020004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:20.020865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:20.023520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 271/558] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.024630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.076409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.097140 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08fc38-d1d5-493d-bd60-fe14845df1f3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.132215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154211af-0a9a-4245-900b-edebe751571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.133337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154211af-0a9a-4245-900b-edebe751571e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.133625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154211af-0a9a-4245-900b-edebe751571e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.133897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154211af-0a9a-4245-900b-edebe751571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.139014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930943b-9b01-4626-bf3b-597f6c584612 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.145666 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154211af-0a9a-4245-900b-edebe751571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.147552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154211af-0a9a-4245-900b-edebe751571e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-154211af-0a9a-4245-900b-edebe751571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:20.165792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.166740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.167696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:20.167696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:20.167696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:20.167696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:20.167696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 288/559] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.168542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154211af-0a9a-4245-900b-edebe751571e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.172711 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.184723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.185493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.185851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.186210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.187045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.187460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.188917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6b6d8-f8f3-4ca3-b92e-55dfb3298836 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.201330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 272/560] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.202843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f805b1-adfa-4ae9-ab46-73c0d2df1828 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.203456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f805b1-adfa-4ae9-ab46-73c0d2df1828 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.203878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f805b1-adfa-4ae9-ab46-73c0d2df1828 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.205494 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 273/561] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:20.206334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f805b1-adfa-4ae9-ab46-73c0d2df1828 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.284837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154211af-0a9a-4245-900b-edebe751571e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.316623 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.319362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f805b1-adfa-4ae9-ab46-73c0d2df1828 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.323679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.324803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.325222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.325564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.326404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.326774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.328298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.337686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 289/562] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.338575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.362791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.363396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.363685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.363965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.364697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.365014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.366404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925887c0-93d9-4317-bd10-9da70d1c4a28 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.378091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 274/563] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.379337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.379623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.379903 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.399102 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:20.400286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:20.441730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a08197-e268-4d0b-a0cf-3707a9a82b16 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.442792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.479712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 275/564] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:20.479712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.485721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.486573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.486899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.487178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.496069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.497539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:20.511644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.512573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:20.513518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 290/565] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.514115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.568436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.576501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf5f1-af8f-486a-8b8c-88fcad224b39 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.615633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edaa2-1dd7-4af2-bf5e-b444c098f8e3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.620045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.620850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.621138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.621418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.632473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.633935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.650260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.651168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.651455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-897db952-6fba-41c2-8cc8-99ad127a218c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:20.651568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.652386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.653264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:20.653264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:20.653264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:20.653264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:20.653492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.653572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 276/566] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.654117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e418e-70ad-427b-91d1-791aabbb9eb1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.654279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e418e-70ad-427b-91d1-791aabbb9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.654519 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e418e-70ad-427b-91d1-791aabbb9eb1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.655952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 277/567] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:20.659883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e418e-70ad-427b-91d1-791aabbb9eb1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.664812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.666288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:20.681015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.682101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:20.683270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:20.686795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 291/568] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.687565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.689438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.763813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e418e-70ad-427b-91d1-791aabbb9eb1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.783352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18f844-1fa3-46e3-b627-3649af026c35 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.797185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.797324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.798012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.798302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.798580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.808657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:20.816413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:20.817346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 278/569] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:20.818646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.819681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.819681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.819681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.819897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.820666 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.820975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.822441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3301c-9e23-41d2-91d3-eb37f0c1378d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.840884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 292/570] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.842119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.842415 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.842714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.860403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:20.861586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:20.905578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:20.924938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c3643-9715-4bf7-87f9-53e6227ced39 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:20.928789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 293/571] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:20.929650 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:20.958620 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:20.959321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:20.959613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:20.959897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:20.960628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:20.960944 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:20.962346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:20.973975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 279/572] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:20.974787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.024260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fe4c-2d8c-45d0-9473-b6c46f763fd0 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.025745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.058142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.058824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.059105 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.059379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.060158 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.060470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.061922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.072941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 294/573] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.073089 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff931-697b-4b8a-9463-9945db06abfc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.073713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.106383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.107092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.107383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.107662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.108417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.108730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.110176 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.117939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 280/574] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.118728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.129058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.172565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca55b3-21ae-4267-aa65-65936cbd44fc None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.204396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.205194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.205472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.205744 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.217473 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.219176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.220294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9da9d4-91bf-4005-8196-cfbde6b48a85 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:21.237115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:21.238188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 295/575] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:21.239387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.254851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.260765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.261663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.262012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.262356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.272566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:21.280237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:21.281409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 281/576] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:21.282431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.337385 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191325a-d5b0-43f2-8eff-faf2a5db1f14 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.347793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.371448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.372259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.372548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.372824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.380506 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.382040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.382599 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ecdb1-ffab-4034-a6b4-e0e7839b3d21 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:21.396025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:21.396999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:21.397939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 296/577] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:21.398527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.421953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.422669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.422929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.423212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.424045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=af84e8d74db94c30afff117043b3c885) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.424360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.425800 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.431358 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 282/578] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/role_assignments?user.id=af84e8d74db94c30afff117043b3c885&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.432336 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.475779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.503677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9f664-fe53-4477-b319-dd739a1b23a8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.544537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.545450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.545750 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.546069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.552210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa7ba-8cf1-46b2-9346-7f577e3ce460 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.557707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.559229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:21.577159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:21.578237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:21.579150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:21.579150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:21.579150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:21.579150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:21.583054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 297/579] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:21.584868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.588134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.593450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.594591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.595238 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.595616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.596575 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.596984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.598490 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.617619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 283/580] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.617619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.701111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a7ac-05fb-402f-a314-ad8c621250bd None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.725248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.731841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f318-c407-477d-a92e-8693730f4325 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.734213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.734913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.735199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.735467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.736232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.736563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.737936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.745919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 298/581] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.746726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.772670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.773333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.773620 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.773901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.774777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.775095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.776534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.794357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 284/582] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.795215 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.852081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.858752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98b668-7036-4756-b0e1-45930596a112 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.894374 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.895084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.895370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.895657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.896382 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:21.896693 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.898105 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.907821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6066e2c-9f96-4818-a942-568e6c5ee0a7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:21.910775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 299/583] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:21.911508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:21.951378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:21.952283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:21.952689 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:21.953098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:21.960410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:21.961974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:21.966141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:21.977178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:21.978283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:21.979403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:21.983329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 285/584] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:21.984150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.026038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77b7ef-38a0-4560-9216-565d3a357c68 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.064432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.065242 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.065525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.066152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.078319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.079815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.090640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e2e3-af3a-493c-a415-d83e331aaea2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:22.101917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:22.103085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 300/585] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:22.103980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.105384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.133131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.133932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.134219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.134502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.145928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.147434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:22.165064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:22.165983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:22.166920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:22.166920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:22.166920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:22.166920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:22.166920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 286/586] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:22.167190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.211775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.215300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e77725-be42-4e49-9ab5-09811ebc360e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.250768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.251677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.251965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.252243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.259464 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.260906 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:22.275104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:22.276200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:22.277316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:22.280844 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 301/587] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:22.281706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.286886 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5ef82-fa98-4a42-af85-48b1f0e16c9f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.323392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.323924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.324215 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.324495 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.325512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:22.325632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.327175 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.343756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 287/588] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:22.343756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.369778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.390469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052491cb-b41a-4d60-ab8a-371666f893c1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.426411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.427544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.427922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.428203 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.428929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:22.429241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.430602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.446171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 302/589] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:22.446171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.453991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb9b0-262f-4b4c-8e2f-9726851c5781 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.466996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.489910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.490579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.490893 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.491172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.491900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:22.492210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.493606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.505956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 288/590] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:22.506632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.551966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78d418-5624-4298-b6ce-925acc4ca8aa None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.588039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.588714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.589002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.589275 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.590111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:22.590418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.591883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.595307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.611292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 303/591] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:22.612123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.619593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b56af9-02d5-4a45-89da-fccf9b53c5f0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.662833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.663739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.664134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.664302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/9ed1f8c70e7148428d64da36b4b4bc22/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.679660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=9ed1f8c70e7148428d64da36b4b4bc22, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.681111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.693958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.706715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 289/592] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:22 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/9ed1f8c70e7148428d64da36b4b4bc22/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:22.706715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.734084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719873b-67d4-40d9-bfe6-9c31ac6ca057 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.782146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.783260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.783619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.783965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.794572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.796612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:22.816863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:22.818084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:22.819185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:22.821696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 304/593] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:22.821696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.823041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57458bc-b1f8-49f7-9568-89d4a60f2c58 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:22.859218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:22.865075 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:22.866183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:22.866565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:22.866997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:22.875868 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:22.877828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:22.897193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:22.898273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:22.899180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 290/594] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:22.899679 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:22.946513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dccaa3-95e0-47b2-84d1-9226668ec3d5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.000478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.001349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.001720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.003443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.013052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.020581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.022488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.023001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ea9e-c085-4a4d-aa5b-28fbba971cf6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:23.046494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:23.047725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:23.048815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:23.048815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:23.048815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:23.048815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:23.051631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 305/595] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:23.056363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.068285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.069222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.070059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.070503 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.071810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:23.072274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.074638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.104137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 291/596] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:44:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:23.104137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.166227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee491-6e9d-473a-b88f-c53209eceaff None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.174738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.202785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.203531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.203813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.204089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.204879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:23.205194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.206636 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.222980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 306/597] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:23.223931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.246677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a82b88-dfba-4dad-88f7-45651aeea545 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.285359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.295296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.297210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.297651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.298076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.299623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:23.300364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.301923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.317652 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 292/598] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:23.318662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.344245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519ad10-1a75-437c-b473-577daabfddc7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.379633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.380626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.381278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.381278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.392887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.394457 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:23.411924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:23.413000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:23.414132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:23.414132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:23.414132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:23.414132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:23.419771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 307/599] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:23.419771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.458439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ab748-a16e-4ad1-b9db-af6e4ec2b3e9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.473425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.505926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.507121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.507587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.508011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.528307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=973379ffb05f4e819502f1ede6635aff, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.530564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.540085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976683e2-2b3a-4cc6-9dfb-9b33195c789c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.541833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.549055 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 293/600] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:23 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:23.549995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.589415 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.590600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.591162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.591642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.601541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.603733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-52ba1e4f-2838-4818-a8fa-5c93d0446ee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:23.625477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:23.626443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:23.627800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 308/601] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:23.632349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3819-d512-4260-9737-2274dc74d9ae None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.632349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3819-d512-4260-9737-2274dc74d9ae None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.632349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3819-d512-4260-9737-2274dc74d9ae None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.632349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 309/602] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:23.639592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3819-d512-4260-9737-2274dc74d9ae None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.686756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e49b-c1c8-42a5-ba31-ec550215022a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.728491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.728753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.729042 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.729327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.730132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:23.730667 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.732436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf548a-1a1f-4a66-9d2c-a4795f1bdcc6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.749325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 294/603] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:23.751418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.751948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.752417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.771500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:23.772898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:23.775769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3819-d512-4260-9737-2274dc74d9ae None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.790517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.825010 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:23.826222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:23.826739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:23.827216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:23.828126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:23.828441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:23.829935 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:23.848680 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 310/604] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:23.849527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.868383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 295/605] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:23.869347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:23.884547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:23.981334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c165cb-26af-4a05-a6b2-b4c829271a51 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:23.985499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc4f34-4419-420f-86cc-e5607b0c7d7a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.018327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.019166 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.019452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.019779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.026822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.028270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.033778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.035169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.035611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.036040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/a86f4c6ca15e47729dfffe6fcf2c5c34/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:24.043241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:24.044372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 311/606] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:24.045497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.059249 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=a86f4c6ca15e47729dfffe6fcf2c5c34, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.061511 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.076740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:24.082538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 296/607] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:23 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/a86f4c6ca15e47729dfffe6fcf2c5c34/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:24.086919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.198359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:24.232890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6086f-f5f8-4e8c-bfae-151a6dd57eb3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.290220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed1ff0-10b8-4f03-a0ee-2e6b88369ebf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.293224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.294113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.294342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.294620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.316191 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:24.323986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:24.324941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:24.325856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 312/608] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:24.330886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.340171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.341646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.342141 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.342751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.343889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:24.344404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.346302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.361946 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 297/609] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:24.367317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.435426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:24.452325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1959897-68f7-490a-a408-7ecaebc89bdc None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.481367 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c093-57ce-4b63-ad72-471b981c29c3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.488627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.489351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.489636 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.489911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.490804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:24.491119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.492508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.502147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 313/610] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:24.511984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.515959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:24.527723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.529145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.529639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.530119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/cd09cd3eee934b22b8b3cad100e8f930/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.572277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=cd09cd3eee934b22b8b3cad100e8f930, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.573742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.604994 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 298/611] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:24 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/cd09cd3eee934b22b8b3cad100e8f930/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:24.667210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea1e46-0a95-44ec-b0e0-09f2a2f9033e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.726954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.727789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.728073 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.728348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.748865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.750408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:24.774887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:24.775891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:24.777392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:24.777392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:24.777392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:24.777392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:24.777392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 314/612] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:24.782167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:24.915662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c6433-b23f-4148-a18b-dfe9bc9a1568 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:24.927041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:24.969441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:24.970141 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:24.970424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:24.970758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:24.971565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:24.971881 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:24.973304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c92f6-699e-4b9e-a5e4-a20f7eca065e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:24.986810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 299/613] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:24.992225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.052148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:25.099355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562cdf-1f2a-4774-a3f6-ce8086ea7cf6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.136429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e90b-e55d-4537-8950-e1925688abf8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.136752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e90b-e55d-4537-8950-e1925688abf8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.137000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473e90b-e55d-4537-8950-e1925688abf8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.138416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.138675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 300/614] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:25.139389 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.139676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.139960 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.148427 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.148721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.148895 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:25.148989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.150361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:25.181440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:25.182424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:25.183393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:25.183950 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:25.186703 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:25.186949 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 315/615] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:25.188201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.321834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 301/616] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:25.350748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.365278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac749ff3-5d88-48ba-8878-a3e931ccb01b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.396201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:25.419431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.420547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.421039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.421578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.422658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:25.423213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:25.424929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:25.443395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 316/617] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:25.448467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.547384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:25.549861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39d536-c332-44e3-9c79-fe6a72256059 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.612316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.613171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.613464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.613742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.626343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021bf1-7166-44d2-a78f-e2b522ea5b57 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.636423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:25.644282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:25.645198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:25.646034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:25.658331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 302/618] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:25.660510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.703859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.704599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.704884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.705160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.723211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:25.724682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:25.753971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:25.754961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:25.755860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:25.755860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:25.755860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:25.755860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:25.764707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 317/619] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:25.775719 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.833585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:25.837901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc14f5-396d-4040-8e0a-0a8562061503 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.924094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.924785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.925072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.925352 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.926125 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:25.926434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:25.927866 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:25.935768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171a324-eb42-4b26-8cb5-531867b677e5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:25.952801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 303/620] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:25.958449 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:25.991514 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:25.992440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:25.992730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:25.993011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:25.993765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:25.994077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:25.996812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:25.997391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.021165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 318/621] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:26.022413 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.130156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678037c2-8eb4-4189-ba02-90e47f07eb2b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.137313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.156043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075779fd-5717-4b3e-9cb3-c7f5f89905b6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.172196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.173054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.173341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.173615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.185048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.186522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.198030 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.198969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.199319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.200054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-37c0b02e-6533-4cb7-ae85-b57fa218567d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:26.204251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:26.205116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:26.206015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:26.206015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:26.206015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:26.206015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:26.206015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 304/622] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:26.210765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc2b2-1fe2-43aa-9e9a-234c863f8f92 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.210765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc2b2-1fe2-43aa-9e9a-234c863f8f92 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.210765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc2b2-1fe2-43aa-9e9a-234c863f8f92 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.210765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 305/623] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:26.211530 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc2b2-1fe2-43aa-9e9a-234c863f8f92 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.217021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.218633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-1bba3b86-2957-4506-be8f-23d1dfc4b1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:26.238095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:26.239100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:26.240001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 319/624] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:26.241307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.241600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.241879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.263864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:26.265909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:26.307657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.344048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc2b2-1fe2-43aa-9e9a-234c863f8f92 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.346084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 320/625] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:26.347108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.384636 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.386417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.386972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.387737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.388839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:26.389665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.392669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.408050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 306/626] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:26.409255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.458014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.489184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3aa58-8d8b-4d1b-8db4-298bdcfa00f2 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.532551 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.532775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0205c-f3e4-499b-a446-9e0edefa3916 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.533480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.533860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.534235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.535505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:26.536804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.538356 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.558224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 321/627] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:26.558224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.577801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.578714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.579082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.579663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.581421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.591923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:26.599943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:26.600906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:26.601765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:26.606781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 307/628] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:26.607346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.693488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53660c3-2994-4585-bf6f-b94479b9fba2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.732307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.732833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.733115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.733389 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.737573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.742239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b76b-7706-4da9-a537-fa77849bde42 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.744710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.746260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:26.762426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:26.763490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:26.764449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 322/629] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:26.765057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.790976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.792872 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.793351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.794008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/af84e8d74db94c30afff117043b3c885/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.812562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=af84e8d74db94c30afff117043b3c885, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.814122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.838744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 308/630] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:26 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/af84e8d74db94c30afff117043b3c885/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:26.838744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:26.931305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c4b5-d50d-4c70-81e7-48a9a2944c56 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:26.932882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:26.973767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:26.974456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.974783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.975064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.976247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:26.976723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:26.978294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634bc8-07d0-4386-9915-7cff261f396b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:26.988959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 323/631] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:26.990362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4295-551a-4264-8754-6981346440f6 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:26.990654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4295-551a-4264-8754-6981346440f6 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:26.991102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b4295-551a-4264-8754-6981346440f6 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:26.996844 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 324/632] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:26.997778 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4295-551a-4264-8754-6981346440f6 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.024158 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb92a-fbf6-4164-834e-909bb75762af None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.068416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.069478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.069986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.070458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.071163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.071794 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:27.072316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.073952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503de8e-85a4-4884-8d85-d7f02b784728 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.094181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 309/633] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:27.096154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.096773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.097269 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.116126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:27.117670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:27.118056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b4295-551a-4264-8754-6981346440f6 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.156523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.157354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.157642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.157923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.171329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.172867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:27.192792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:27.193776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:27.195110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:27.195110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:27.195110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:27.195110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:27.195110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 325/634] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:27.199482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.207569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 310/635] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:27.208675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.245516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.336376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d6808-d9d6-47b5-9dcc-dac3c6622792 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.343890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bfff5-d66b-4409-9083-13fb3fdce38c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.355069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.371520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.372191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.372477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.372759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.373542 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:27.373924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.375331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.381064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.381726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.382014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.382595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.387472 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 311/636] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:27.388201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.458943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.461116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.488045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.500906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42887fc8-8256-4637-bc00-95b183b82cfc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.536535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.537338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.537621 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.537898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.547998 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a80ece52-a935-4148-ad56-aee658756306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:27.555748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:27.556705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:27.557523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 312/637] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:27.558841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a25cf-c8b8-4a63-a414-c3258597de30 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.559010 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a25cf-c8b8-4a63-a414-c3258597de30 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.559242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a25cf-c8b8-4a63-a414-c3258597de30 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.563156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 313/638] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:27.563156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a25cf-c8b8-4a63-a414-c3258597de30 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.569728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 326/639] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:27.570756 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.585005 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.677053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a25cf-c8b8-4a63-a414-c3258597de30 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.679274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df1fa-c45a-4839-a8df-784ae9e745c1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.712413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.713213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.713501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.713796 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.717348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.718505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.718963 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.719380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.720271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:27.720758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.721587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.722160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b1645-4506-42d9-9774-ddb38df74296 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.723056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.735571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 327/640] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:27.735571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.735571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.735571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:27.737740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:27.738645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:27.739616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 314/641] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:27.740808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.754545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:27.755836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:27.756803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.824924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 328/642] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:27.825555 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.828050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:27.858599 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29e3d7-b018-475f-9811-bd7fcf9ef868 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.901556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.902606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.903086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.903526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.915556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.917196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:27.925525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19515500-9b14-48df-9010-ded560e5d9f9 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:27.936899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:27.937901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:27.938839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:27.938839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:27.938839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:27.938839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:27.940571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 315/643] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:27.941372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:27.965406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:27.966537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:27.967021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:27.967509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:27.979355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:27.981339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:28.000566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.001526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.002603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:28.002603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:28.002603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.002603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:28.004632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 329/644] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.005531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.011063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.060341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493474d-6132-4736-adb1-479733ac24b1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.074755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.100353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.101038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.101324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.101604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.102455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:28.102798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.104250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.120590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf3b81-269c-46a7-96ea-034b15dc5cb7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.122119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 316/645] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:28.123093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.162057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.162888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.163172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.163447 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.173681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:28.181343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.182268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:28.183160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 330/646] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.183862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.235512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db67516-df3b-413a-b7d3-02a7954a39e1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.258455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.270309 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.271013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.271297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.271577 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.272307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:28.272616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.273990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.285868 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 317/647] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:28.286391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac963bd-a07c-4ec3-af0e-1fca0acc5137 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.287616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.302157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.323933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.324591 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.324874 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.325157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.325891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:28.326206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.327642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.344978 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 331/648] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:28.344978 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.390485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88889cc-ac5b-4e6c-955d-478c24f62360 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.428577 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.429473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.429926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.430212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.446972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32661e-0fea-4807-9020-35304e5b3610 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.481664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.484494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.485589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.485883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.486165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.487225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:28.487539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.489410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.501072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 332/649] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:28.502002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.505424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.507187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.536115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.599899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f1f8-e309-4f04-9a50-d343d9338199 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.621328 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 318/650] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:28.621328 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.639965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.640952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.641664 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.641947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.650615 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.652603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:28.669027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.669993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 333/651] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.676287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.717874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.739225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490262dc-c1f4-4643-955b-22db573f98f2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.769460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.776247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3f177-0b9c-4368-b776-01cc45f64404 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.777600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.778410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.778715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.779013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.786296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.787781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:28.805538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.806509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 319/652] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.808066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.816655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.817470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.817759 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.818038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.829068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.830966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:28.850644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.851689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.852598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:28.852598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:28.852598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.852598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:28.852598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 334/653] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.852875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:28.921714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cc78f-0522-491d-9b15-2e3097ebb3f3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.961848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584b768-2e4b-4927-8e77-9222b384a958 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:28.962298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:28.963373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:28.963885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:28.964368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:28.974926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:28.976339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:28.978212 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:28.995781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:28.996914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 320/654] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:28.997824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.005316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.006007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.006290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.006571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.007407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.007720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.009166 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.025823 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 335/655] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.025823 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.034530 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.104199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf872-699b-4c1e-a808-a90d204b90fe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.128851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b841-d3b7-4a55-b928-7febb42e5343 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.141624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.142281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.142572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.142895 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.143745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.144061 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.145505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.162123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.162285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 321/656] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:44:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.162828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.163081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.163175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.163444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.164106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.164417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.165790 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.177709 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 336/657] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.178508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.219471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.245105 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.266785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213454f-1c0c-4c9d-a3c6-8270c9b687c5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.277908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4644-f246-413f-882e-c1bb070bee84 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.301657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.302318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.302597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.302874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.303680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.304226 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.306398 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c760-e60e-4fa0-b859-6215a5e3e1f9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.311272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.311956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.312273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.312555 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.313393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=9ed1f8c70e7148428d64da36b4b4bc22) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.313711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.315188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.320498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 322/658] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.330846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 337/659] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/role_assignments?user.id=9ed1f8c70e7148428d64da36b4b4bc22&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.330846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.331159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cd5a-e318-481f-9eef-7dba46fb9ae8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.331159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cd5a-e318-481f-9eef-7dba46fb9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.331159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cd5a-e318-481f-9eef-7dba46fb9ae8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.331159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 323/660] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:29.331159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23cd5a-e318-481f-9eef-7dba46fb9ae8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.447290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73037fb-6d3b-43a4-a238-5692a4d2b412 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.455670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23cd5a-e318-481f-9eef-7dba46fb9ae8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.471122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.486298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.492572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.493251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.493539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.493791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.497699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.498446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.498764 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.499048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.508723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.510407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:29.527674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:29.528669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:29.529601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 324/661] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:29.530202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.571989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.573473 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fcf1d-0b15-414f-956c-ba5d63c2df01 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.639760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b7c5-2ef8-47da-a184-6c3178694cf2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.682206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.683048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.683343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.683626 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.687642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 338/662] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:29.689234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.689905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.690470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.690972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.692532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:29.708310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:29.709520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:29.710559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:29.711569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:29.711569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:29.714374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 325/663] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:29.715255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.742988 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.751002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.784497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 339/664] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:29.785159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.836901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028abd-4a47-425a-a257-9d7df6132138 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.872471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.873540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.873838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.874109 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.875025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:29.875385 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.876835 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.885454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25987d-48bb-4f3b-a2f7-32f53bdaa7ae None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:29.898618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 326/665] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:29.898618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.924731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:29.925538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:29.925830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:29.926109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:29.936750 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:29.939607 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:29.958707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:29.959643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:29.960534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:29.960534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:29.960534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:29.960534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:29.960534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 340/666] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:29.960827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:29.976882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:29.992591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.004991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ce65-9646-491c-98ef-14d69342874e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.040083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.040758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.041046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.041324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.042114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:30.042428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.044088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.062074 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 327/667] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:30.062074 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.078721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f7e4e-dd6d-4acf-bdb4-ac39885a9e8b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.118467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.120009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.120442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.121081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.133150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:30.141269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:30.142392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 341/668] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:30.143439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.175166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d67b81-6936-4ecf-bd00-20fe5f100feb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.210997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.211651 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.211934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.212206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.223496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.232030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.250270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8c92-50df-4b42-9e95-11b4a6567679 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.284068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.284234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.284643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.284930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.285208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.285468 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.285931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:30.286241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.287642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.304587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 342/669] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:30.304587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.393518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 328/670] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:30.394366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.409392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9188d52-b6f1-4a79-8804-567e0214d910 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.444348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.445320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.446167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.446590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.447703 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.449040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:30.449528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.451212 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.453296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.470501 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 343/671] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:30.471675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.502489 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bca506-175b-4e2f-acee-6aac077ca141 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.543228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.544234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.544702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.545161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.546114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:30.546721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.548447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.558302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 329/672] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:30.559554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.615848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b94931-6172-4c49-9c5c-1e00f4aaf9c3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.666239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.667085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.667363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.667635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.677408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.678121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.689939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec22c-5ae8-4acd-9c7f-b5306b701470 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:30.696376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:30.697331 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:30.698217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 344/673] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:30.699259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.707678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.734493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.735443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.735812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.736111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.747295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.748852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:30.769683 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:30.770649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:30.771628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:30.771628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:30.771628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:30.771628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:30.771628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 330/674] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:30.772255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.778218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:30.827434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70835-7e1d-4c97-b647-493506792387 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.870044 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.871358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.871765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.872249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.885451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.887841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.889765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b403f-06d0-496b-93f9-6e7a23559660 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:30.909850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:30.910997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:30.912121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:30.912121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:30.912121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:30.912121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:30.912121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 345/675] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:30.912476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.933920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:30.934763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:30.935052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:30.935608 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:30.936409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:30.936768 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:30.938830 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:30.955666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 331/676] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:30.959723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:30.988869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.022785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c901555-b704-4b97-badf-3467a5bb2077 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.035214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.060581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.061436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.061801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.062305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.063175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.063581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.065067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.072380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034235-efd8-484b-86a3-ba9e475965a3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.081847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 346/677] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.081847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.113659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.114580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.115019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.115431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.116384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.116888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.118461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.131318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 332/678] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.132521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.191315 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcc29d-d6b1-4779-9989-8fcd1109b79c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.223311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.240043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.240708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b5183-fae6-4d31-8a9a-b979e4c541bc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.241242 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.241740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.242443 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.244377 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=a86f4c6ca15e47729dfffe6fcf2c5c34) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.244894 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.246542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.261189 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 347/679] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/role_assignments?user.id=a86f4c6ca15e47729dfffe6fcf2c5c34&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.262852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.310848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.311855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.312133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.312409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.320922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.334631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.336422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:31.373374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:31.374586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:31.375715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:31.380892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 333/680] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:31.390749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.496917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62115cc5-a722-4937-84f3-a7ebaa4664f4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.509358 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101d15-41ee-41be-982c-bfb5de98e313 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.548296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.548972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.549259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.549541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.550438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.550781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.552325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.562068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.563644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.564150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.564624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.565266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 334/681] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.570910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.574110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.575480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.576251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-c3102e28-9888-4634-80d0-9d240a4355ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:31.598376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:31.599535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:31.600651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 348/682] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:31.601260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66305-5508-4c87-88cf-4f2e9e53ade5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.601337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66305-5508-4c87-88cf-4f2e9e53ade5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.601619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66305-5508-4c87-88cf-4f2e9e53ade5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.603446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 349/683] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:31.606588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66305-5508-4c87-88cf-4f2e9e53ade5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.709712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46892cd3-3366-42cd-8816-d2ec44b96f50 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.743383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66305-5508-4c87-88cf-4f2e9e53ade5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:31.753959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.755084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.755376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.755662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.756513 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=cd09cd3eee934b22b8b3cad100e8f930) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.756833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.759052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38cd31-7f98-4977-8e2a-b24e4caea4cd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.767375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 335/684] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/role_assignments?user.id=cd09cd3eee934b22b8b3cad100e8f930&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:31.768647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.768939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.769225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.790721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.790938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:31.791838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:31.791945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:31.792530 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:31.792999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:31.793415 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:31.795696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:31.796375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:31.798305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:31.837876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 350/685] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:31.843733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.920891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:31.940394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 336/686] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:31.964392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:31.993595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65b48-16f9-4a4f-a7e4-45bac392e1d8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.045396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.046642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.047033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.047409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.075981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.116187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc89f77-4ca2-4ef7-ba9c-69e58ae2778b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.131252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.132722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.154912 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.156178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.156718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.157232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.158270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.160039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:32.176603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:32.177558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:32.178397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:32.181534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 337/687] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:32.188606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.258571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 351/688] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:44:32.263876 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.268878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.330498 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b4140-d46c-434a-be9d-5aeeb5a1a989 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.347513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.398287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.399282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.399716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.400139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.401008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:32.401484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.403297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.417305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 338/689] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:32.427004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.443206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2b793-1a5a-48ff-94d6-9fcedb78003f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.478710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.479910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.480456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.481373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.492197 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.493981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:32.512416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:32.513362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:32.514308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:32.514308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:32.514308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:32.514308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:32.516673 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 352/690] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:32.521702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.636170 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d61d-aa49-4712-9f93-a7c27b810a46 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.696154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.711992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371e48-af5f-422a-a061-b1f885b4e527 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:32.715052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.715763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.716056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.716331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.717063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:32.717375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.718859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.721588 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:32.732048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 339/691] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:32.787629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:32.788368 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:32.788661 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:32.788942 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:32.789686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:32.790000 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:32.791417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7715ff3-4e8f-4d59-9965-5aace3e7496f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:32.806424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 353/692] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:32.812267 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:32.971880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf584e-49a5-457a-85d5-bca1bfedab7e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.008635 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.009447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.009730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.010008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.018022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306b72-9186-43a3-b606-74fb7f9dee4a None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.018620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306b72-9186-43a3-b606-74fb7f9dee4a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.019006 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:33.019358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef306b72-9186-43a3-b606-74fb7f9dee4a None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.020480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:33.021246 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 354/693] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:33.026849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.027238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.027529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:33.035416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:33.036310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:33.037207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 340/694] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:33.044770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.049965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:33.051200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:33.142342 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:33.194852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 355/695] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:33.230013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e910b-dfaf-4592-baf6-71b5140b3ee9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.259777 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.278805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.279484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.279773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.280050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.280910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:33.281224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:33.282673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:33.310337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 341/696] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:33.316466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.427788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bf3c3-973f-4884-afc3-0bdc7cd4bc87 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.437370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:33.438967 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:33.447584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695cdb0-bb18-4af1-8fc8-b4ed636ee8cd None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.463584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.464260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.464884 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.465268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.466335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=af84e8d74db94c30afff117043b3c885) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:33.466813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:33.468418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:33.479081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 342/697] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/role_assignments?user.id=af84e8d74db94c30afff117043b3c885&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:33.514327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.515196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.515480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.515755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.535818 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:33.543682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:33.544606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:33.545460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 356/698] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:33.554833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.666572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08fb87-a924-4ce1-8c82-672d2d2b4493 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.702926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.703627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.703918 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.704201 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.705039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:33.705361 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:33.706932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:33.717037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 343/699] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:33.722944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.845306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a4ac9-3190-4ce3-9922-fa0ccfb4bc7b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:33.883692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:33.884489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.884765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.885033 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.897226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:33.898706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-550ad3a9-dc54-41aa-b38b-69c57450bb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:33.917553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:33.918468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:33.919404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:33.919404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:33.919404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:33.919404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:33.919404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 357/700] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:33.927181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:33.967411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:33.969519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d1ffd-6419-400d-82c0-0a97c5aece48 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.970038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d1ffd-6419-400d-82c0-0a97c5aece48 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.970505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d1ffd-6419-400d-82c0-0a97c5aece48 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.973142 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 358/701] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:33.978555 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:33.979127 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:33.979597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:33.998038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.008507 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:34.010017 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:34.042524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade1d1-3f02-4a71-a7e3-647f80d73a06 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.082791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.083484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.083765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.084152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.084792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:34.085110 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.086587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.104252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 359/702] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:34.110718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 344/703] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:34.115190 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.146357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.296861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f51208-f358-4a6c-b453-7266e381f1eb None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.328444 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.339734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde35b9-56b8-4c24-b290-e9209de2a526 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.362007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.362750 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.363036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.363309 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.373393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.378514 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.380031 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:34.400947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:34.401911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:34.402880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:34.406774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 360/704] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:34.409239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.422440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.423617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.424094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.424558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.443122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.445945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:34.473529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:34.474509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:34.475425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:34.475425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:34.475425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:34.475425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:34.477413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 345/705] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:34.487654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.592538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4e02d-2c9e-4614-a33d-3a34cf698cb8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.631216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.631903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.632189 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.632468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.633317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:34.633629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.635090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.679144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 361/706] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:34.680149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.703305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490be2f-83ce-4c01-8a30-21c9bb027638 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.762900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.763412 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.764758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.765296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.765717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.766617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:34.767213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.769670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d70f50-cec1-4fa0-a2c5-1e73be079d3b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.787659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 346/707] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:34.789368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5728-0e6e-4c43-bd03-d57a29ffc420 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.789882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5728-0e6e-4c43-bd03-d57a29ffc420 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.790303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5728-0e6e-4c43-bd03-d57a29ffc420 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.792084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 347/708] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:34.793027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5728-0e6e-4c43-bd03-d57a29ffc420 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:34.808875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97b42-cf70-4c8a-8f2f-ff862b2b4f1c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.809840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.843575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.844238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.844519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.844795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.908306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5728-0e6e-4c43-bd03-d57a29ffc420 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:34.913072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.914594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.946283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:34.947389 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.947901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.948466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:34.949478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:34.951208 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6d8fc-b7c7-40a8-b0bf-23b830e48a9d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:34.969848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:34.983260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 348/709] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:44:34 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:34.985369 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:34.985931 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:34.986430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.029167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:35.030408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:35.157172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 349/710] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:35.159177 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.180227 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.223381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 362/711] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:44:35.233665 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.348247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fff9e-9a01-4a37-b8ca-7faa42c21457 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.356175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bd82b-e33e-4acf-af2a-ceceddd3fa0f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.397212 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.398049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.398330 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.398602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.411214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.412630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-165e2870-8f7b-411c-ad58-346d561b2f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:35.432740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:35.433642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:35.433642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:35.433642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:35.433642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:35.433642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 363/712] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:35.434766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e869-8102-47b2-8898-683a15ad7a00 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.435057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e869-8102-47b2-8898-683a15ad7a00 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.435336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e869-8102-47b2-8898-683a15ad7a00 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.437027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 364/713] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:35.441631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e869-8102-47b2-8898-683a15ad7a00 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.459078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.523843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.524663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.524940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.525213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] PATH_INFO: `/v3/services/network` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.525876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.527372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8a87cb6a-c201-4ef7-9ab5-db8967048523 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:35.542993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:35.544005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:35.544913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 350/714] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/services/network => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:35.545744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.550797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.550797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.564796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e869-8102-47b2-8898-683a15ad7a00 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.570589 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:35.571885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:35.602157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.603154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.603654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.603947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.604669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:35.604981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.606704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.622720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 365/715] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:35.623956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.645319 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.672655 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 351/716] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:35.673835 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.728428 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.765589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799e6f0-6e32-449f-a7d3-8ac3c3c015f2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.802412 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.803168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.803461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.803741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.804458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] RBAC: Adding query filter params (name=network) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:35.804770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.805079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936aada-87f0-4c50-9dcc-53e1b3228859 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.806147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.815088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 366/717] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:35.815977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.849076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.850477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.850981 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.851491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.860889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.863271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:35.882243 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:35.883263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:35.884165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:35.887134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 352/718] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:35.888140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:35.926878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fefae-1c68-42f8-a268-9f4d6e60cf47 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:35.959082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.966456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:35.976192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:35.977739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:35.978231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:35.978741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:35.980094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:35.982630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.005856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 367/719] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:44:35 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:36.006419 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24007-15aa-47e8-99b8-b4d45b0c34a9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.007324 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.149694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.150386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.150676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.150976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.151701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] RBAC: Adding query filter params (type=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:36.152656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.153425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.158354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee5b0-2ecf-4efa-ad74-09b2edd869a9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.159325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 353/720] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:36.196609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.197554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.197976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.198388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.199388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:36.199838 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.201432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28aeeb-22d7-48b5-a4a4-37efa6606382 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.217450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 368/721] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:36.223277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.299631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3cf17-cbc2-4b3f-a6e5-9317b31fa66d None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.299921 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3cf17-cbc2-4b3f-a6e5-9317b31fa66d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.300219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3cf17-cbc2-4b3f-a6e5-9317b31fa66d None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.301864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 369/722] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:36.308020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.308466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.308846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.331777 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:36.333026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:36.385758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145b215-d7e7-47ed-b4a8-d27a999b9914 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.396403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:36.401388 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:36.437478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.438150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.438433 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.438738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.439624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:36.440268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.442012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.448959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 354/723] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:36.450111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 370/724] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:44:36.481161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.623870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cccf2f-b10a-46f8-b8cc-b52235d6c0e6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.694164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.694999 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.695281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.695554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.707064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:36.714523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:36.715526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:36.716855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 355/725] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:36.722018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.874259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cf8f6-2bfe-4e3c-8942-40593737e39e None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:36.920080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:36.921179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:36.921655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:36.922139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:36.923104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:36.923601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:36.925202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:36.937914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 371/726] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:36.943438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:36.978759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:37.057614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1282580-b8b0-4f9a-b0c4-c407235a4d27 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:37.095440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:37.096631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.097103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.097583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.115773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:37.117557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:37.141769 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:37.142786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:37.143685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:37.143685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:37.143685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:37.143685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:37.145648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 356/727] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:37.151220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:37.200496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:37.267152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deef64-1ce6-4ae0-9a1f-6165d59f26d9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:37.300907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:37.301585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.301869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.302144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.302905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:37.303217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:37.304594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:37.317361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 372/728] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:37.322382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:37.482424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:37.503348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abccbc-10f2-4bca-b17e-9854c6f8a467 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:37.555754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:37.556522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.556816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.557102 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.566383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:37.567915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1fc90376-059b-4f0e-84c6-b9c1d2600efd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:37.586123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:37.587166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:37.588755 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 357/729] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:37.593337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:37.740346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:37.747431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ce925-e5ba-451f-8a0d-8694ba8833a3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:37.791966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:37.792646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.792925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.793198 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.794042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:37.794352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:37.797466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349d98-d142-4c0e-943c-242a15a20616 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.797754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:37.797876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349d98-d142-4c0e-943c-242a15a20616 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.798051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26349d98-d142-4c0e-943c-242a15a20616 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.799691 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 358/730] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:37.812237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:37.812517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:37.812746 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:37.819188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 373/731] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:37.824998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:37.847153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:37.848363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:37.959735 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11fc99-14ff-4941-8db8-da8c068ea853 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:37.981257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 359/732] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:38.004015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.004674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.004955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.005229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.019153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.045765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.125769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.127172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.150163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.177682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3ea48-5c5f-436a-9c2a-6db27cbda176 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.213536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.214339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.214618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.214943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.227731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:38.236245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:38.237165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:38.237991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 360/733] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:38.243250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.359812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecec606-ca77-4c7c-b11d-640e2d61f703 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.391539 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 374/734] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:44:38.398637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.401087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.401776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.402058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.402338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.403128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:38.403436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.404825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.406475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.421211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 361/735] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:38.422571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.544031 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.545556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbac68-1cfd-48d7-a6d7-19a4706d4f85 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.597172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.597984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.598262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.598530 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.618662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.620152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.637574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28612c63-6333-4a83-bb2f-4b4f6690768a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:38.669040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:38.670080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:38.670997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:38.670997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:38.670997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:38.670997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:38.671997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 362/736] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:38.679837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.703375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.705292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.705587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.705864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.728996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.730493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:38.760657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:38.762842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:38.765103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:38.765103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:38.765103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:38.765103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:38.771550 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 375/737] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:38.772442 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.786117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.842220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129507-0393-48de-b3ce-28e9c92fd9f9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.887320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.887991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.888273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.888547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.889270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:38.889574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.891063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b182b-91a1-4cf3-b83e-6fb0d737654b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.903235 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 363/738] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:38.904547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393396-c2e9-4ee3-8b3b-0c875e1061c8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.904839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393396-c2e9-4ee3-8b3b-0c875e1061c8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.905116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393396-c2e9-4ee3-8b3b-0c875e1061c8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.906643 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 364/739] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:38.907991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393396-c2e9-4ee3-8b3b-0c875e1061c8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:38.913087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324e41c-6f75-4574-9bfd-86358d396288 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:38.922538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:38.949633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:38.950319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.950601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.950904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.951645 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:38.951953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:38.953577 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76b5b-0aee-47c0-8108-8dc373f33c07 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:38.971156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 376/740] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:38.971156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7df05-646e-46ab-897e-d0c0ea3bdc5c None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:38.971156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7df05-646e-46ab-897e-d0c0ea3bdc5c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:38.971156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7df05-646e-46ab-897e-d0c0ea3bdc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:38.989034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-71e7df05-646e-46ab-897e-d0c0ea3bdc5c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:38.990216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-71e7df05-646e-46ab-897e-d0c0ea3bdc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:39.019896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393396-c2e9-4ee3-8b3b-0c875e1061c8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.029320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.055447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.056260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.056596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.056863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.061162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 377/741] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:39.062420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035aca-b62d-4665-bf52-0d611a98a13b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.062730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035aca-b62d-4665-bf52-0d611a98a13b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.063012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86035aca-b62d-4665-bf52-0d611a98a13b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.066883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 378/742] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:39.067026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.067110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86035aca-b62d-4665-bf52-0d611a98a13b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.067193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8c13c1e8-f0f7-4dc0-8fba-b3f3e82e8495 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:39.082574 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:39.083816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:39.084997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:39.086984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 365/743] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:44:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:39.088405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d893-5685-4cff-9b81-633c25767608 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.088691 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d893-5685-4cff-9b81-633c25767608 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.088963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932d893-5685-4cff-9b81-633c25767608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.105344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5932d893-5685-4cff-9b81-633c25767608 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:39.107032 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5932d893-5685-4cff-9b81-633c25767608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:39.187579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 366/744] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:44:39.188467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932d893-5685-4cff-9b81-633c25767608 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.192675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.203603 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86035aca-b62d-4665-bf52-0d611a98a13b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.237493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.238281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.238558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.238910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.245447 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.246924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:39.260290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:39.261351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 379/745] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:39.262273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.285695 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.290058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932d893-5685-4cff-9b81-633c25767608 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.324719 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.325387 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.325672 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.325949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.326674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.328120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8816e2-312f-448f-b722-de800e53730b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.343035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 367/746] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:44:39 2022] POST /identity/v3/services => generated 240 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:39.344677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3253-4dd6-4cd3-9212-07b548f65132 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.345150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3253-4dd6-4cd3-9212-07b548f65132 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.345610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3253-4dd6-4cd3-9212-07b548f65132 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.352093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 368/747] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:39.352093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3253-4dd6-4cd3-9212-07b548f65132 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.368119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed7b41-09a1-45cd-a091-6cc6da80cfb6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.413581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.414398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.414833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.415354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.416073 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:39.416506 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.417915 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.437554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 380/748] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:39.438283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.456425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.480073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3253-4dd6-4cd3-9212-07b548f65132 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.519882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.520702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.521007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.521270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.521918 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.523340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-85a963eb-2af7-4dd7-933d-89f2623c41b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:39.538019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:39.539229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:39.540200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 369/749] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:39.541234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.541234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.541234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.559457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:39.560882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:39.565026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b6769-cb9f-41fd-9a2d-464df51dda0c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.579280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.601810 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.602483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.602795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.603071 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.603862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:39.604171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.605913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.622820 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 381/750] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:39.622820 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.642723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 370/751] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:39.642723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.701258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.735514 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cd870-d171-4db1-901c-cde83b154d52 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.756731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0506f8-197f-4de3-9ced-63f947224fd5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.771167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.771870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.772169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.772448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.791154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.791820 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.792102 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.792378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.793090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:39.793396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.794805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.800420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 371/752] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:39.800420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.819459 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.846340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.847994 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.902355 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9428-3278-4825-9279-bd77b52742cc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:39.919924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:39.938305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:39.939031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:39.939311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:39.939583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:39.940422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=af84e8d74db94c30afff117043b3c885) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:39.940735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:39.942173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:39.948066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 372/753] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/role_assignments?user.id=af84e8d74db94c30afff117043b3c885&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:39.948838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:39.966253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 382/754] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:39.967518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.065090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.094857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd231072-bcab-4df2-8d97-3380de7cd82b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.098997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3f568-5a24-4dd6-a042-f5a59307501d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.134308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.135682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.136154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.136641 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.144893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.145570 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.145851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.146129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.146879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:40.147529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.148846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.153402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:40.156202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 383/755] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:40.157595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:40.163229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:40.164178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:40.165021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:40.167461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 373/756] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:40.168465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.199620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.268714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3b194-c0ef-4654-9d1f-44a190c9de8f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.293548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef5541-86b8-4d3e-ae5b-8cdcd3c22b9a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.305221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.306257 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.306743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.307176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.319587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.321340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.329765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.330600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.331012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.331390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.332629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] RBAC: Adding query filter params (interface=public, service_id=83cbbcb4461f49fe907d36a701ac2746, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:40.332750 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.334237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:40.342791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:40.343729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:40.344646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:40.344646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:40.344646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:40.344646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:40.346647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 384/758] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:40.346873 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 374/758] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/endpoints?service_id=83cbbcb4461f49fe907d36a701ac2746&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:40.347790 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.349336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.352255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.455802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.459135 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c3f5-7d77-4b90-940d-8a46c4c861b1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.470512 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d054ad-2297-44fe-a249-5490a1dc5ab0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.497145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.498079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.498508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.499058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.500112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:40.500567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.502101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.509807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.510652 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.511307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.511931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.516841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.516841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.517197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 375/759] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:40.518399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.526801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 385/760] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:40.526801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.668916 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f01c3-3198-46bb-8ae7-375b930fc4d1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.686403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.754355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.755216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.755497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.755774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.763522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2530c8-a64b-4ec8-9534-cf43c3bca502 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.779639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.781433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:40.803640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:40.804601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:40.805516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:40.805516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:40.805516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:40.805516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:40.814177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 386/761] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:40.814334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:40.814334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:40.814334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:40.814334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:40.814678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:40.815062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:40.816358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.819202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:40.824462 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:40.840902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 376/762] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:40.854198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:40.971971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ef076-5b82-413f-96db-390e06d267e5 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:40.988145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc39992-f03c-4d71-b4ca-a3cac69343f1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.017407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.026905 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.027787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.028098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.028394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.036244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.037811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:41.053446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:41.054390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:41.055326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:41.059130 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 377/763] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:41.060632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.062436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.063143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.063424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.063693 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.064566 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:41.064870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.066244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.100982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 387/764] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:41.116239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.195087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b2c0-de5f-421d-aaee-9adef7320c63 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.231754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.232439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.232728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.233171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.233883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:41.234198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.235694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.253780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 378/765] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:41.254734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.304471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.311260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.359534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d3ab-87ac-4df7-9137-71c9d6e7acfc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.380677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53426ad-e9ff-46d4-8926-738dd0c9254e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.395283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.396071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.396424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.396771 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.397704 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d30d379aa2c74f81846bf50c049610ac) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:41.398096 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.399802 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.415515 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 379/766] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/role_assignments?user.id=d30d379aa2c74f81846bf50c049610ac&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:41.448347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.449310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.449667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.450018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.460874 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.462409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-36729792-4a29-44d7-8f63-f72f60f5abd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:41.483730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:41.485239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:41.486335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:41.490276 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 388/767] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:41.491782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.613863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce52bb-a7c0-499b-9963-ee62a6cc321b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.614041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce52bb-a7c0-499b-9963-ee62a6cc321b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.614324 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce52bb-a7c0-499b-9963-ee62a6cc321b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.616064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 389/768] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:41.621905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.622193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.622464 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.649341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:41.650553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:41.656777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1b77-b23b-46a3-b92d-3991680496e6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.669139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.716710 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.717946 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.718452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.719002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.720046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:41.720661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.722471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.725897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 390/769] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:41.741715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 380/770] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:41.747070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.757397 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.802375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:41.847148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e7a0a-12a6-4de4-a500-e2a6dd92ae08 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:41.881294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:41.882118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:41.882408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:41.882709 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:41.893036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:41.894518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:41.912223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:41.913162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:41.914037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:41.914037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:41.914037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:41.914037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:41.914037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 391/771] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:41.918990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:41.973504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8c41-46bb-453e-8002-10f2ab226035 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.027117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.028036 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.028559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.028839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] PATH_INFO: `/v3/services/network` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.029500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.031088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:42.044812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:42.047214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:42.049351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 381/772] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:42.051241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845077-7c08-49c7-bd88-5dde525f2465 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.060529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.061765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.090931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.091808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.092094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.092416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.093222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:42.093533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.094947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.110808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 392/773] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:42.113346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.135072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.218173 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24c6c7-eafb-44e6-8850-5c43c140c02c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.222808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ae5c-85b9-4dae-9d80-31509d07ea9e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.257102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.257920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.258202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.258476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.259499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.260402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.260891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.261353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.262251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] RBAC: Adding query filter params (name=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:42.262799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.265061 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.270461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 382/774] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:42.275806 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.275937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.282734 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:42.292540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:42.293452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:42.294336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 393/775] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:42.301133 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.363052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.392345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.398783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a26b7-318c-41b8-808d-57258271e948 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.435330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.436364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.436907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.437396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.438298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] RBAC: Adding query filter params (type=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:42.438922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.440515 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.446079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 383/776] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:42.451665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.563220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3857c5-3058-489f-950d-87e0517f5212 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.585732 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a013-6595-4df6-8a99-eab00eebdb3c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.600844 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.601915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.602423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.602939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.603939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] RBAC: Adding query filter params (interface=public, service_id=9d32f95d9c06427bbbcaf68ad81d4503, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:42.604444 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.606346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.613240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 384/777] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/endpoints?service_id=9d32f95d9c06427bbbcaf68ad81d4503&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:42.618326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.651209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.714669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.715307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.715563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.715841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.716639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:42.716950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.718637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484421d-1751-48c5-9979-89fbc26f0ef7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.728535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe1170-951d-4d0c-9e4c-33e46839da8f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.732167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 394/778] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:42.733111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8be44-bcef-4c30-bf94-4a6fdda3bbeb None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.733541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8be44-bcef-4c30-bf94-4a6fdda3bbeb None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.733875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8be44-bcef-4c30-bf94-4a6fdda3bbeb None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.738776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 395/779] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:42.740459 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8be44-bcef-4c30-bf94-4a6fdda3bbeb None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:42.777670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.778758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.779236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.779681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.780581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.782761 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7c53-affe-4674-a1b4-579ac687b8df None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.791254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 385/780] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:42.793479 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.794045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.794507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.819841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:42.822063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:42.843179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:42.857229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8be44-bcef-4c30-bf94-4a6fdda3bbeb None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:42.935243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:42.936397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:42.936904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:42.937341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:42.940482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=973379ffb05f4e819502f1ede6635aff, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:42.942129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:42.958522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 386/781] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:42.969605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 396/782] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:42 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:42.985369 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.007045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:43.100568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635860c-cc40-4215-ac53-444507ff2a41 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:43.139462 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:43.140330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.140613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.140889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.153379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:43.161295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:43.162294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:43.163179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 387/783] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:43.168969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.286802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ddd18-80f7-4752-8378-9e9e44ac4867 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:43.320668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:43.321349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.321640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.321920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.322678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:43.323016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:43.324399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d90d8-4531-4caa-b78f-339c1e4e75ed None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:43.333131 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 397/784] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:43.338775 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.462332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:43.484392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f97df-8e1c-48c0-9816-72c9d04e69e2 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.484711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f97df-8e1c-48c0-9816-72c9d04e69e2 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.484971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f97df-8e1c-48c0-9816-72c9d04e69e2 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.487808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 398/785] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:43.491764 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.492058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.492472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.493403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d549bc-41b4-46b0-97e4-866d38f2649e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:43.526046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:43.527266 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:43.529611 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:43.559571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:43.560298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.560576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.560851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.581166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:43.582639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:43.615833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:43.616821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:43.617731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:43.617731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:43.617731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:43.617731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:43.617731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 388/786] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:43.623680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.646310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 399/787] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:43.695880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.746516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22ef08-2c5e-44be-b1f7-e8759d60dc24 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:43.793983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:43.802781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:43.803461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.803743 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.804018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.804753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:43.805053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:43.806432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:43.831521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 389/788] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:43.836858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda1d40-7169-4e82-b52e-8dc3f1dca161 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:43.839015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.907395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:43.908243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:43.908517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:43.908802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:43.909474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:43.910883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:43.928952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:43.929973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:43.930849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 400/789] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:43.937850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:43.944976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:43.996863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c94728-4a60-41bf-8541-a27df8aad46c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.034402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.036025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.036520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.037026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.045022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.046834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:44.063606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:44.064728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:44.065701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:44.068371 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 390/790] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:44.073460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.171107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.183240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102236ac-6d85-4ce7-999c-20ad1aee3613 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.228185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c7347-5e3e-483a-b42b-34008d70265a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.231821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.232751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.233264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.233809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.234950 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:44.235559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.237813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16773d9-c475-4cc1-b8a8-effae8328519 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.262904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 391/791] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.263213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.263870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.264160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.264439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.265216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:44.265528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.266011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480e9c-11af-4f62-ac59-dedee3e44398 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.266512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480e9c-11af-4f62-ac59-dedee3e44398 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.266924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358301-d67c-4f76-b6ab-129d4ae811f4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.267318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8480e9c-11af-4f62-ac59-dedee3e44398 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.269845 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 392/792] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:44.270989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8480e9c-11af-4f62-ac59-dedee3e44398 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.276071 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 401/793] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.277449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.277744 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.278024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.294743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:44.296054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:44.364627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.378945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 402/794] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:44.379849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.408436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8480e9c-11af-4f62-ac59-dedee3e44398 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.447178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.459303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.461027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.461529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.462021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.476556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.479038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.501621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225ceed-b635-4129-ab49-9d73219ed5e0 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:44.501803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:44.502646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:44.503584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:44.503584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:44.503584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:44.503584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:44.503584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 393/795] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:44.504313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.555869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.557631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.558124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.558874 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.560086 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:44.560972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.562649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.570657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 403/796] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.571977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.612784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c97b57-3d37-4655-81b5-423bb98f9030 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.649572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.654434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.655909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.656428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.656905 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.672803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:44.683819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:44.684822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:44.685681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:44.693329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 394/797] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:44.693329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.704920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349c9b5-17a0-4f0c-b96e-55d186765470 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.716960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.752477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.753811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.754547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.755025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.756607 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:44.757121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.759602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.775679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 404/798] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.776814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.802311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56c4c5-5895-4361-9fc2-63aa0cd7cf1c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.838291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.839059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.839349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.839631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.840383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.841772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.868128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 395/799] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:44:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:44.869229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.904477 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f162ba5-ad96-425a-939a-6604d8c77a8e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:44.928139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.949265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:44.950045 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:44.950489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:44.950806 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:44.951681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:44.951997 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:44.953474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:44.963046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 405/800] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:44.975406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:44.976675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:44.997535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a962-16e9-46e8-afd8-1895996d6fad None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.037209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.038132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.038420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.038712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.046748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.048245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:45.063976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:45.066057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:45.068263 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 396/801] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:45.072050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.178455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b754-c128-44f3-90c5-305eaeda33ac None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.188855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863692-f312-4a08-a69f-0748379ad70e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.216840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.217571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.217923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.218199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.231039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.231757 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.232376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.232493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.232660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.232932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.233786 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:45.234099 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.236312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.239255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:45.251827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:45.252783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:45.253677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:45.253677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:45.253677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:45.253677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:45.253916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 397/802] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:45.253989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 406/803] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:45.257996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.267716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.311533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.389182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1cb15-f2f2-4976-8e4a-3561b6c40812 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.400294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821fb10-492d-4d6a-930f-16becd9edf7e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.438607 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.439701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.440176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.440667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.441955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:45.442480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.444259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a3eea-f223-474b-aeb9-0225914555df None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.445230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.446137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.446422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.446752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/af84e8d74db94c30afff117043b3c885/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.449637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=af84e8d74db94c30afff117043b3c885, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.451124 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d5c1b-a860-4cd7-9e6e-6e3d3f7d4c1c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.459045 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 407/804] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:45.461755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68f12-5b73-4102-8baf-e852475d8181 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.462251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68f12-5b73-4102-8baf-e852475d8181 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.466107 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68f12-5b73-4102-8baf-e852475d8181 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.468090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 408/805] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:45.469171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee68f12-5b73-4102-8baf-e852475d8181 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.472731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 398/806] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:45 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/af84e8d74db94c30afff117043b3c885/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:45.475522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.475811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.476092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.501694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:45.503897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:45.574606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.581819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.587169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee68f12-5b73-4102-8baf-e852475d8181 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.610324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 399/807] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:45.637205 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.637416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.639081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.639760 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.640247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.662274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.663883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:45.684870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:45.685898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:45.686930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:45.691628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 409/808] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:45.697394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.768114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcc315-79c7-4aca-919e-4b21b8b0167b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.805435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.806246 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.806537 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.806824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9a9ab-49dd-4542-a872-2cf9d041c502 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.806930 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] PATH_INFO: `/v3/services/network` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.807570 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.809921 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6f3f5c30-f6ba-407c-92fa-85a2e9fa4b9c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:45.824814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:45.825823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:45.827151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 400/809] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:45.827962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5b80-49e8-4864-941a-950ff0d2a286 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.828366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5b80-49e8-4864-941a-950ff0d2a286 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.828828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5b80-49e8-4864-941a-950ff0d2a286 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.830159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 401/810] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:45.835193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5b80-49e8-4864-941a-950ff0d2a286 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:45.847889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:45.848572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.848860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.849234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.850088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:45.850491 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:45.851980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cac11b-c46c-4d6d-a8d8-81abec4a2eb3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:45.871736 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 410/811] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:45.873508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:45.873927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:45.874326 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:45.891617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:45.893058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:45.896021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.907046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:45.957741 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5b80-49e8-4864-941a-950ff0d2a286 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:45.982804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 411/812] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:45.983845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.010105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.010803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.011088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.011363 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.012081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] RBAC: Adding query filter params (name=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:46.012393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.013772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.021402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 402/813] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:46.022563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.108116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8b721-90c9-4f32-b215-06733bb68f97 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.149358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.150824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.151757 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.152493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.160707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef51be-0b29-4eef-a5a0-0cde41879e58 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.166562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.168896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.175240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.193535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:46.195388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:46.196320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:46.197277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:46.197277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:46.197277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:46.197277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:46.200209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 412/814] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:46.201364 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.201596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.202549 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.202956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.203332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.216717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:46.226488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:46.227483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:46.228338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:46.236452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 403/815] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:46.236452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.328396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed731f-bf69-48c1-b061-98df7ec446f7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.354733 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe027f-4876-4d4f-b0f8-c045c6850f7f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.368021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.368793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.369143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.369768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.370367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] RBAC: Adding query filter params (type=network) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:46.370799 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.372233 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.377803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 413/816] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:46.378614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.399316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.399993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.400280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.400558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.401296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:46.401613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.403002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.415868 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 404/817] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:46.416862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.450451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.457434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.512605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea271a1-39f4-452e-a83b-ceca1298c30f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.526836 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49235df-7368-4cb8-a569-9b958798de6e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.558668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.559961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.560524 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.561038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.562277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:46.562896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.563424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.564181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.564562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.564906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.565282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.565783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.567270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.576572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 414/818] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:46.577748 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.590179 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 405/819] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:44:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:46.591460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.704363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa67e-0158-4732-8357-6a063ffa6370 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.723169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.747474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:46.750547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.751513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.751831 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.752219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.760231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.760859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2ee0-4bc0-438e-a0fb-7d3bb1391615 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.761909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:46.787656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:46.788629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:46.789526 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:46.792434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 415/820] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:46.801237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.829710 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.830541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.830854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.831129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.853900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.855333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:46.878676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:46.879671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:46.880818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:46.880818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:46.880818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:46.880818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:46.880818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 406/821] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:46.889709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:46.935095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233d53-009d-467d-855a-965aac3411a4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:46.971646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:46.972323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:46.972613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:46.972893 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:46.973695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:46.974012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:46.975474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:46.987996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 416/822] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:46.994654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.030611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a76f2-6de8-40b4-8ec0-bb378547077f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.039896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.089583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.090273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.090562 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.090928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.091838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:47.092160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.094393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.112023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 407/823] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:47.117247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.124390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.128004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a786a1-f89c-4539-bbe0-0c5ea4596b2a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.168990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.170498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.171103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.171781 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d30d379aa2c74f81846bf50c049610ac/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.189828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=d30d379aa2c74f81846bf50c049610ac, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.191995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.218714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 417/824] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:44:46 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d30d379aa2c74f81846bf50c049610ac/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:44:47.244113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f78fa7-6d53-4392-916a-06275b66e98d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.282580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.283438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.283723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.284002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.292747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.294422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:47.312308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:47.313317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:47.315020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 408/825] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:47.320880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.421034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.440124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f82ef-8ce9-4678-9254-5e978108c6a8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.477201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.477889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.478172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.478451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.479334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:47.479648 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.481400 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b3ebd-d7f5-4a61-908a-28b2a7f52f74 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.500116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 418/826] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:47.507445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.566669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6ece-80a4-4fc0-a2f2-c18857afc267 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.566938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6ece-80a4-4fc0-a2f2-c18857afc267 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.567104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6ece-80a4-4fc0-a2f2-c18857afc267 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.568720 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 419/827] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:47.572865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.573659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.573976 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.574224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.592896 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:47.594193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:47.623993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06076-88b7-4082-9224-962dcad2b7d1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.675145 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.675728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.676016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.676299 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.683708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 420/828] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:47.707772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.769421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.771904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4b1ec-8671-4baa-8225-a9b0163bbe00 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.780867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.813944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca453c2-3ebe-418c-be56-4002e5a31d02 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:47.849398 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:47.851076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:47.852230 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.852692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.853117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.853921 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:47.856243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:47.873581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:47.874908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:47.875952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:47.882722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 421/829] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:47.884354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:47.902825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 409/830] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:47.904173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0643-ad86-44cf-99db-ccfa7265ae0a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:47.904467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0643-ad86-44cf-99db-ccfa7265ae0a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:47.904749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f0643-ad86-44cf-99db-ccfa7265ae0a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:47.906268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 410/831] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:47.908706 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0643-ad86-44cf-99db-ccfa7265ae0a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.001961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50999d3-3142-46dc-ae95-9442d95fda46 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.022747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f0643-ad86-44cf-99db-ccfa7265ae0a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.038616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.039380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.039601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.039892 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.040600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.040909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.042281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe5566-e15d-41cd-b0af-a18958a6bd2c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.043326 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.048406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 422/832] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:48.049649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.049937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.050213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.063347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.064170 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.064441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.064727 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.068115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:48.069292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:48.075570 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.077081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:48.096713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:48.097850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:48.099004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:48.099004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:48.099004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:48.099004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:48.100567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 411/833] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:48.101486 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.117861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.150725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 423/834] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:48.150725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.206557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9fd48-9dcd-4653-a0d2-926036afbeeb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.241758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.242427 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.242734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.243020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.243738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.244059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.245456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.250296 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 412/835] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:48.251124 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.275367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30c763-dd13-498a-82e4-b82f34b0a1a1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.311273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.323542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.325283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.325789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.326580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.327879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.328865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.331076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.348714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 424/836] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:48.354262 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.355265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.387763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015209-71ac-4c34-b6ca-6f17e273bdd8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.439222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.440402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.440855 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.441137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.455238 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:48.463245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:48.464188 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:48.465051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 413/837] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:48.470257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.476319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e06ad-e6de-4c10-bbab-2687b3f56dd2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.517189 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.518001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.518288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.518567 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.525760 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.527180 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:48.541727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:48.542660 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:48.543654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 425/838] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:48.550290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.601884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.602840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274919-1f91-4040-8bc8-8008eed096dc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.658200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.659242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.659733 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.660214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.661178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.661728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.663348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.665482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215888-06d3-4d48-a284-745a57f6a3ea None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.669948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.680138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 414/839] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:48.681335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.710050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.710765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.711057 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.711340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.712408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.713095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.714875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.737372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 426/840] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:48.738586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.803398 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450848e-3ad6-484e-bf49-9277f4ff4d10 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.841076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.842253 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.842898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.843377 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.854455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.856625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.862120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e190dd-5e61-4811-ae93-d3afa97e3ff3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:48.872718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:48.876286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:48.877555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:48.878543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:48.878543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:48.878543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:48.878543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:48.880674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 415/841] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:48.890828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:48.899840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:48.900505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:48.900790 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:48.901068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:48.901903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:48.902217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:48.904117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:48.912370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 427/842] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:48.960484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.016373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143561f-104f-4cef-9ace-5aeb9bf5ee76 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.056640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.057629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.058082 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.058508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.059439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:49.059896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:49.061549 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:49.075585 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 416/843] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:49.081658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.187179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ae79-161f-4461-8ff0-cf30a13b3610 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.221912 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.222999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.223458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.223886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.232147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:49.234309 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:49.248941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:49.250206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:44:49.251431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:49.253686 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 428/844] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:49.259499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.365224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893035-23d7-4763-ba4d-b11caf65e0e4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.381123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.406761 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.407768 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.408204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.408627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.409637 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:49.410111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:49.411813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33ceba-25b9-4203-8f10-a916008be332 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:49.431286 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 417/845] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:49.437305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.470537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.541649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39386a2-df74-42c0-8bde-265860fca928 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.569276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df17c-49f3-4fb8-aed2-92887a53060c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.569602 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df17c-49f3-4fb8-aed2-92887a53060c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.569847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932df17c-49f3-4fb8-aed2-92887a53060c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.571392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 418/846] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:49.576242 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.576535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.576819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.585165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.585825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.586114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.586390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.596020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:49.597218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:49.672922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 419/847] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:49.678969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:49.680440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:49.695971 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.711165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.802860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.804041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 429/848] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:49.810417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78faa1-4ed4-4d55-ad48-916e3b56b7d4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.811503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.849050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.849856 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.850309 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.850801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.861697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:49.869657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:49.870819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:44:49.871713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:49.873948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 420/849] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:49.882731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:49.940984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130538d1-67bf-4798-8146-f1254d2316d2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:49.972502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:49.978944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:49.980824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:49.981317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:49.981816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:49.995511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:49.998078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.010114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b385-4a4d-453d-b964-93f8dc9adc86 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:50.021929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:50.022868 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:50.023766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:50.023766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:50.023766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:50.023766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:50.029111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 430/850] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:50.031601 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.055702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.056743 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.057227 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.057696 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.058707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.059229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.060869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.074323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 421/851] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:50.076040 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.104632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.143021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af33436-3535-461f-95dd-ef079caad8f6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.179371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.180047 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.180334 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.180614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.181341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.181842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.183389 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.191649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8d8ed-8828-4324-85b8-167a06e8b5ff None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.200252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 431/852] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.202971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.235758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.236991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.237566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.238128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.250876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.252547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.253573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:50.275380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:50.276334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:50.277224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:50.277224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:50.277224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:50.277224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:50.284071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 422/853] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:50.285876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.309032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6434-71db-46a2-9254-d7b23e21538d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.343169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.343983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.344269 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.344552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.351840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.353401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:50.368504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:50.369465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:50.370347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:50.374640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 432/854] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:50.375698 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.377003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.404336 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a8b84-1350-4400-807e-efe9978fd97b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.445009 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.446037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.446518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.447089 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.448138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.448643 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.450304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.467841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 423/855] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:50.469412 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.482955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d8936-728c-4667-b4a0-2fefa7dd8b1c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.485344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.518306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.519006 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.519488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.519915 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.520860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.521321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.522986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.540187 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 433/856] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.541379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.580636 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f7de7-5353-4e79-b93c-f4cb2772b474 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.615083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.615958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.616250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.616529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.618506 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.624962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.626515 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f745fc11-56a7-4220-82fc-635439060ed7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:50.641569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:50.642558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:50.643857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 424/857] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:50.644462 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790dcca-86a4-4356-b26f-f3c943983fbb None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.644462 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790dcca-86a4-4356-b26f-f3c943983fbb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.644585 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790dcca-86a4-4356-b26f-f3c943983fbb None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.649916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 425/858] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:50.653935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790dcca-86a4-4356-b26f-f3c943983fbb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.654054 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f8e4-fe3c-42b6-99c0-a36da58c59a4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.689788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.690554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.690869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.691147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.691986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=af84e8d74db94c30afff117043b3c885) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.692302 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.693734 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24776b0c-251e-4bf4-988e-c36b5ac26c86 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.707358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 434/859] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/role_assignments?user.id=af84e8d74db94c30afff117043b3c885&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.707358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.707358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.707358 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.720290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:50.721687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:50.756706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.775737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790dcca-86a4-4356-b26f-f3c943983fbb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:50.822748 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 435/860] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:50.829066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:50.829781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:50.830066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:50.830345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:50.838780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:50.838780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:50.838780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:50.849865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.861655 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 426/861] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:50.870731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:50.933625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:50.994513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d7a1-2d0a-4c85-90c0-3a0bec81aafe None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.023816 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221c93-c6b7-46f0-b5ec-72ca958ba126 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.036076 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.036855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.037207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.037549 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.038359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.039899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad02d-f43d-45d2-9079-b13900d42adb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.056755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 436/862] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:44:50 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:44:51.106823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.108927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.109858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.110547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.196931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc108e-efbb-4536-ba14-ac43f7db2b71 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.197199 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc108e-efbb-4536-ba14-ac43f7db2b71 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.197494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc108e-efbb-4536-ba14-ac43f7db2b71 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.199174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 437/863] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:51.205038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.205320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.205589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.224688 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:51.226307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:51.243747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:51.244451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.248123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.317819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 438/864] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:51.331075 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:51.340232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.446731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 427/865] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:50 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:44:51.450737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.451658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97586b3f-3051-443e-b089-5d1e1d1eefc2 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.489722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.490913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.491268 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.491614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.492458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.494114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:51.508032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:51.509002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:51.509855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 439/866] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:51.519944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.536470 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:51.578784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a845-9f55-4583-bebe-ad39abf808d5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.616218 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.617484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.617983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.618474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.626214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74801f5-4d09-48dd-bcfd-4c456f86031d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.630067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.631798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.641094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:51.653007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:51.653890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:51.654842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:51.654842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:51.654842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:51.654842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:51.657209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 428/867] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:51.663517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.664228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.664335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.664624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.664974 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.665763 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:51.666156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.667655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.673962 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 440/868] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:51.678763 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.759620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:51.784253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d8a4-09be-412a-8f20-a5a3ae04e734 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.799952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2197ff5-05ed-4d8c-af79-381fe4c05e9d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:51.819172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.819846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.820136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.820420 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.821152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:51.821454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.822865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.835152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 441/869] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:51.845001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:51.846071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:51.846571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:51.847124 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:51.848105 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:51.848632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:51.850347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:51.864929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 429/870] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:51.875756 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:51.991024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca9a98-dd0e-4893-943a-55977dd8b9f6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:52.028440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:52.029592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:52.030175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:52.030640 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:52.037871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:52.039565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:52.043232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:52.055904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:52.056819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:52.057701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:52.060196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 442/871] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:52.066318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:52.137420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:52.175008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d5cc7-294f-4a36-a596-7c9c7e35f411 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:52.209433 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:52.210468 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:52.210980 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:52.211450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:52.212633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:52.213154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:52.214802 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10c9c5-d1dd-4310-8839-0ca452a73a81 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:52.228313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 430/872] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:52.234201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:52.339209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939de0f1-9ec7-4a29-8406-6f735a5c951e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:52.375408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:52.376078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:52.376363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:52.376643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:52.377487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d30d379aa2c74f81846bf50c049610ac) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:52.377805 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:52.379283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2e66b-04e1-4e4e-baba-7c91d463ecc9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:52.385617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 443/873] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:52 2022] GET /identity/v3/role_assignments?user.id=d30d379aa2c74f81846bf50c049610ac&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.242975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd658e-6923-4f03-8974-0949920b7b35 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.243539 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd658e-6923-4f03-8974-0949920b7b35 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.243837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd658e-6923-4f03-8974-0949920b7b35 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.245580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 431/874] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:53.251162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d60f6-ae9f-4591-8ed3-9da9f1498f3e None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.251602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d60f6-ae9f-4591-8ed3-9da9f1498f3e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.251915 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d60f6-ae9f-4591-8ed3-9da9f1498f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.269100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-947d60f6-ae9f-4591-8ed3-9da9f1498f3e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:53.270288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-947d60f6-ae9f-4591-8ed3-9da9f1498f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:53.329565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.338053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 444/875] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:53.360685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd658e-6923-4f03-8974-0949920b7b35 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.402869 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66adca-a4ab-4d81-915a-29ae91edc52c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.403184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66adca-a4ab-4d81-915a-29ae91edc52c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.403440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66adca-a4ab-4d81-915a-29ae91edc52c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.405119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 445/876] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:53.411771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.412172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.412552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.430321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:53.431925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:53.466401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd658e-6923-4f03-8974-0949920b7b35 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.488173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.502874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.503612 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.503974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.504256 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.504926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.506311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.507106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 446/877] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:53.518939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:53.520127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:53.521164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.522715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 432/878] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:53.528039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.534128 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.644363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b613f27-269d-4bf9-ab06-244ba8e58e68 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.647708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4b2fd-9d65-4216-9f8d-f4e279695288 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.672193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.682612 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.683483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.683781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.684065 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.684170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.684743 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.684860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.685027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.685300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.686013 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:53.686311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.686431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.687894 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.693213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 447/879] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:53.699277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:53.700271 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:53.701119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 433/880] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:44:53.702500 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.711692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:53.765120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:53.820134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a47a8e-6826-4c1d-a976-6a86310a0392 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.834743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8ba5-3d06-4949-9ed2-b455ae390f81 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:53.866862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.867836 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.868306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.868792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.869673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:53.870115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:53.870361 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.870813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:53.871102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:53.871384 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:53.872100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:53.872414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:53.872886 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.873807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:53.879438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 434/881] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.887207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 448/882] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:53.888883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:54.010416 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab06246-8bd4-4f13-8db5-8cf282c98a10 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:54.025721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:54.050699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:54.051390 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.051680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.051960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.052687 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:54.053007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:54.054413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2847-feea-4563-829a-4958ee245f6e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:54.060566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 435/883] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:54.066525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:54.111694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ac943-b13e-4fbf-99a0-2689d7c2818b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.111988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ac943-b13e-4fbf-99a0-2689d7c2818b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.112270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ac943-b13e-4fbf-99a0-2689d7c2818b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.113780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 436/884] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:54.118915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.119210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.119497 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.127927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:54.137134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:54.138341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:54.182558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc960c33-4ec9-4347-a5e4-9a99ef659249 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:54.210705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 437/885] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:54.228676 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:54.229352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.229645 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.229924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.231115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] RBAC: Adding query filter params (interface=public, service_id=43167518e9af414fb5f246d3c5e72137, region_id=RegionOne) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:54.231434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:54.232826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:54.233799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:54.241080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 449/886] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:44:54 2022] GET /identity/v3/endpoints?service_id=43167518e9af414fb5f246d3c5e72137&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:54.248134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:54.354986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fe73-6003-4948-8fe7-ec3260005627 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:54.367628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:54.380128 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298c68a-94e6-4f2d-a095-28b92c63fc12 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:54.398022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:54.398857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:54.399840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.400287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.400718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.401604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:54.403524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb34d3-2253-4cdb-89cd-5bb36d74bd47 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:54.422794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:54.423768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.424135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.424542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.425488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:54.427176 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 438/887] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:44:54 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:44:54.427301 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210eaad-8a37-408c-9087-be4bac0fb4c9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:54.434743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 450/888] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:44:54 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:44:54.720171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d71a-6f8c-419b-aad6-9529645f9a86 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.720527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d71a-6f8c-419b-aad6-9529645f9a86 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.720734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422d71a-6f8c-419b-aad6-9529645f9a86 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.722354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 439/889] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:54.727855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:54.728757 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:54.729494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:54.763349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:54.764970 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:54.859369 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 451/890] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:54.919708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422d71a-6f8c-419b-aad6-9529645f9a86 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.096760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422d71a-6f8c-419b-aad6-9529645f9a86 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:55.182327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:55.183111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:55.183391 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:55.183675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:55.211777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:44:55.228138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:55.229233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:55.230149 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 440/891] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:44:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:55.236145 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.336587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81992ff-0b8c-4d02-82b4-acc8ef53cfe2 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:55.344333 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:55.371753 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:55.372439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:55.372725 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:55.373002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:55.373807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:55.374123 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:55.375534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:55.384409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 452/892] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:44:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:55.389742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.420140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:55.494615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cda3d0-16ae-46e5-8e0b-6a86ab8cbb87 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:55.527686 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:55.528730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:55.529209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:55.529689 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:55.540378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:55.542034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:55.558952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:55.559862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:55.560793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:55.560793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:55.560793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:55.560793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:55.562773 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 441/893] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:55.570803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.668286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5d471-2e04-406d-9bb7-4ba1e33176d2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:55.702286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:55.702980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:55.703260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:55.703534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:55.704391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:55.704700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:55.706069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:55.718579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 453/894] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:55.724139 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.806869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:55.829828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64086a23-7aa1-4b85-b7ca-5e5abf42a9de None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:55.864228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:55.865062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:55.865351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:55.865633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:55.873535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:55.875148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:44:55.889809 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:55.890878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:55.892001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 442/895] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:44:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:55.896968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:55.925989 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.000154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3c129-4f0c-4cc5-9c12-6147eaf6aec9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.035319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.036224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.036672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.037109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.038082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:56.038534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.040138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf55b1-145d-4239-a503-a4f89c7a9747 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.058982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 454/896] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:44:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:56.064853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.170120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da575d-def1-46be-94b7-ec4a120755d4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.207197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.208196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.208675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.209138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.218565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.280833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.282629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.348553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb28d-4f07-41b5-98e8-f84e87b27cec None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.348826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb28d-4f07-41b5-98e8-f84e87b27cec None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.348996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb28d-4f07-41b5-98e8-f84e87b27cec None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.354913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 455/897] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:56.357399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.357904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.358411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.376388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:56.377940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:56.390812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 443/898] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:44:56.395732 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.440386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.464214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 456/899] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:44:56.481609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.501956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.510588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7ec38-60b8-4937-8c6f-684480059d22 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.546273 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.547213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.547564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.548029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.558472 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.560041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:44:56.577953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:56.578928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:56.580272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:44:56.580272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:44:56.580272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:44:56.580272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:44:56.583933 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 444/900] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:56.584967 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.601061 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc214a1f-2eeb-4aa7-a4c3-50659351c597 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.637630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.638339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.638625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.638939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.639854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.641455 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.662525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 457/901] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:44:56 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:44:56.677687 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.688168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731006e-4281-458b-8a65-77d98c3860c5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.734897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.736097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.736544 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.736821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.737585 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:56.737894 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.739352 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa361b-3847-4b14-b7ca-1ffdaa382d63 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.757834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 445/902] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:56.763701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.852029 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:56.881943 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6fe3c-c17c-4a83-bcb3-9375640759ab None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:56.917825 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:56.918631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.918937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.919209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.926383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:56.927919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:44:56.942226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:56.943209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:56.944110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 458/903] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:56.946379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9dcd-fde4-4121-9226-6ea334b3a9e5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.946674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9dcd-fde4-4121-9226-6ea334b3a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.947019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9dcd-fde4-4121-9226-6ea334b3a9e5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.948808 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 446/904] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:56.949150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:56.954192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87fa5-8e67-4f1a-80b8-b7a104299a61 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:56.954482 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87fa5-8e67-4f1a-80b8-b7a104299a61 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:56.954815 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87fa5-8e67-4f1a-80b8-b7a104299a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:56.972199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-92f87fa5-8e67-4f1a-80b8-b7a104299a61 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:56.973499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-92f87fa5-8e67-4f1a-80b8-b7a104299a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:57.047153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 447/905] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:57.063591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a34f-6e10-42f8-a8fc-16dd3f411394 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.063910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a34f-6e10-42f8-a8fc-16dd3f411394 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.064197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a34f-6e10-42f8-a8fc-16dd3f411394 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.065694 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 448/906] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:57.071244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.071526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.071802 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.073541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c604d3-218c-434f-bb9d-cc0296c593e9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.092630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:57.094084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:57.119435 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.120803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.121310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.121955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.123728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.124270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.126741 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.130670 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.143168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 459/907] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:57.143886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.176450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 449/908] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:57.177551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.190524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.249625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ef3af-6e0a-4cc3-914a-67836cb6246d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.286956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.287865 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.288094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.288376 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.289053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.290432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.299161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799eab4-2371-4e05-ae47-7c8a7e7194b1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:57.303224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:57.304218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.305063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 460/909] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:57.305911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.339231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.339922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.340209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.340496 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.341354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] RBAC: Adding query filter params (role.id=04ac5d337a4c4237b040d62662680190, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d30d379aa2c74f81846bf50c049610ac) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.341664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.343225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.348709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 450/910] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/role_assignments?user.id=d30d379aa2c74f81846bf50c049610ac&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=04ac5d337a4c4237b040d62662680190 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:57.349491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.385137 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.439084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156d9c-92f3-423e-b9b1-dbb59c957073 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.466928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.481342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.483149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.483637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.484099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.484964 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.486918 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:57.500855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:57.501933 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:44:57.502972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:57.505767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 461/911] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:57.514782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2887e64-9ae3-4b7e-ba3d-52a3053cdde5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.515036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.551166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.551848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.553163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.553163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.553163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.553417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.556558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.564046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 451/912] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:57.569634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.619380 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a2d5-51a8-4b3f-9f6d-965ed0fa36a3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.644169 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.657011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.658212 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.659083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.659083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.659946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.660621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.662077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.670765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 462/913] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:57.673007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.683510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6c21-8bdc-47c4-80dc-7dbdaa096b51 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.720840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.721884 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.722314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.722876 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.723728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.724181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.725937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.727447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.738846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 452/914] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:57.740770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.774308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc48f4-3509-4223-8dec-b23e7d40bdcd None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.807231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.807901 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.808183 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.808458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.809351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.809482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.810845 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.820704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 463/915] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:57.821520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.851620 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cd3e0-f17e-469d-916f-968076f81bb3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.883422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.902508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.903376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.904521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.904913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.905681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] RBAC: Adding query filter params (interface=public, service_id=d9b71246f6e24090a9a4875eb7a32bd5, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:57.905999 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.907410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:57.914821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 453/916] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/endpoints?service_id=d9b71246f6e24090a9a4875eb7a32bd5&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:44:57.920334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:57.939295 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec45923-4b4c-4795-9b8c-9461be8d6d9c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:57.986893 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:57.989688 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:57.990366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:57.990649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:57.990951 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:57.991939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:57.994548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b6cb1-06ce-4468-a936-c33a3ee9b733 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:58.023508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 464/917] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:44:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:44:58.041987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6456eb-a2a7-4527-ac6c-8ecc73f6875f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:58.087022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:58.087705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:58.087980 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:58.088254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:58.088941 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:58.090347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09451a1-e2a6-47fe-b9f8-4106adcaa16d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:58.098004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 454/918] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:44:57 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:44:58.960192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe838-7c45-467f-a1bc-11e55ac8bc50 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:58.960701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe838-7c45-467f-a1bc-11e55ac8bc50 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:58.960701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe838-7c45-467f-a1bc-11e55ac8bc50 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:58.962020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 465/919] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:44:58.967628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:58.968114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:58.968309 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:58.985858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:58.987086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:59.057859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 455/920] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:59.080260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe838-7c45-467f-a1bc-11e55ac8bc50 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.184493 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe838-7c45-467f-a1bc-11e55ac8bc50 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.195520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:59.221824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.222561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.222877 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.223154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.223815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:59.225249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:44:59.238200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:44:59.240503 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:44:59.242465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:44:59.250712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 466/921] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:44:59.251009 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.304719 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:59.352730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151e3ac-3a8f-4652-8a30-ee8a759f5a21 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.388134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.388872 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.389214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.389491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.390257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:59.390566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:59.392054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:59.397492 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 456/922] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:59.403052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.516586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624b3ec-24d4-447b-b75c-9d533ab2c4a3 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.552390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.553267 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.553557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.553836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.554545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:59.554880 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:59.556332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f16fe-6904-4608-abef-4e075ca212a7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:59.562034 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 467/923] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:59.567774 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.678232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db77b-4760-4be8-83e8-d299899eca51 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.680516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e933e-2f84-4b4d-957c-f9eea26233c8 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.680819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e933e-2f84-4b4d-957c-f9eea26233c8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.681102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e933e-2f84-4b4d-957c-f9eea26233c8 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.683704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 468/924] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:44:59.687863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.688156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.688438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.697421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:59.707110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:44:59.709324 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:44:59.716444 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.717120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.717522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.717802 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.718606 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] RBAC: Adding query filter params (interface=public, service_id=0f49378bf06349fa98760c96bfd94aa2, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:44:59.718961 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:59.720381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:59.730987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 457/925] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/endpoints?service_id=0f49378bf06349fa98760c96bfd94aa2&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:44:59.732331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.748819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:44:59.795592 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 469/926] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:44:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:44:59.817851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:44:59.843004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809bed-f3e8-4cdc-af6b-b0d0175014d7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.880522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.881334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.881736 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.882024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.882759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:44:59.884223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:44:59.898709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 458/927] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:44:59.942653 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19114e9-9ad6-47f9-bea4-56c0d4ff9e16 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:44:59.984111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:44:59.985004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:44:59.985383 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:44:59.985667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:44:59.998300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:00.006948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:00.007983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.009058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 470/928] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:44:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:00.016362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.071098 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.130058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f056b-a376-4692-b533-4fcd83d7b013 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.166236 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.167393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.167900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.168394 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.169396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:00.169924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.171720 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23493053-8a2c-4f89-a40a-8ed1288336ff None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.185052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 459/929] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:00.191046 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.224905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.309249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6278c-a7e9-4c3d-bfb7-41db82fea97a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.345680 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.346454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.346772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.347047 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.358562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.360039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.361995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881c5-e84d-4860-b7be-bc30ad29428f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.362291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881c5-e84d-4860-b7be-bc30ad29428f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.362575 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038881c5-e84d-4860-b7be-bc30ad29428f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.364228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 460/930] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:00.369067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa468-e828-4229-952d-8e537341c0a4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.369362 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa468-e828-4229-952d-8e537341c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.369647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aa468-e828-4229-952d-8e537341c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:00.379299 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:00.380215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:00.381336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:00.381336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:00.381336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:00.381336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.381336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 471/931] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:00.386889 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e92aa468-e828-4229-952d-8e537341c0a4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:00.387519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.388097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e92aa468-e828-4229-952d-8e537341c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:00.468039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 461/932] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:00.469382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccbae-3480-4ac9-b03c-2945c76f355c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.469673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccbae-3480-4ac9-b03c-2945c76f355c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.469955 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccbae-3480-4ac9-b03c-2945c76f355c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.471477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 462/933] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:00.479847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.480131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.480727 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.482751 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.498577 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:00.500039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:00.505748 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf4b01-a9dd-4fd2-b7be-19e628b42fec None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.535732 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.541973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.542657 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.542972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.543253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.543985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:00.544297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.545949 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.557952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 472/934] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:00.558613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.581197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 463/935] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:00.582356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.666743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82c2c-ebf4-4698-8530-5b5a95853222 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.694345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606414-9691-4a87-9fe8-14cb6083932b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.703078 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.703886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.704155 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.704434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.705272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.706722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.708237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: WARNING keystone.server.flask.common [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 19:45:00.717279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.730824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.731014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.sql.core [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:45:00.731014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:45:00.731014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [parameters: {'id': 'f16515d3908c474da8e7f7a8dea42135', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:45:00.731014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80283) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:45:00.731654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.731939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.732217 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.739612 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.741122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f16515d3908c474da8e7f7a8dea42135.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f16515d3908c474da8e7f7a8dea42135. May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application conn.query(q) May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:45:00.748112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result.read() May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 19:45:00.749038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application next(self.gen) May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application yield resource May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application next(self.gen) May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise self.value May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application session.commit() May 19 19:45:00.750092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.session.flush() May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application compat.raise_( May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:45:00.751727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:45:00.752635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application conn.query(q) May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result.read() May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:45:00.753416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [parameters: {'id': 'f16515d3908c474da8e7f7a8dea42135', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.754281 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.756398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f16515d3908c474da8e7f7a8dea42135. May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 473/936] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 19:45:00 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:00.758796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:00.760875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:00.762514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:45:00.764798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:00.766903 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 464/937] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:00.767745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.795120 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:00.868153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3979af-0cb9-4233-bfc8-04e1c062814a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.871535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ecaf8-4bfa-4d0d-8a78-2765a9d9646e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:00.907139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.907885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.908173 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.908454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.909117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.909849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:00.910647 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:00.910771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.910951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:00.911321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:00.918343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:00.919807 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.923689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:00.924617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:00.925467 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 474/938] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:00.926323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:00.939161 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:00.940101 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:00.941025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 465/939] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:00.941510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:00.998570 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.032776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.047068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de863-8dbf-462c-9765-a623605e3ecc None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.050029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbb842-7842-4119-a4b6-2d8805830700 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.082610 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.083284 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.083654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.083918 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.084743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:01.085008 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.086463 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.087691 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.088372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.088662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.088944 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.089670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:01.089986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.091402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.096859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 466/940] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:01.097068 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.113082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 475/941] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:45:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:01.114237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.207477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00cc2d-f287-456b-b741-2e371774d8ca None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.219771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c24ed7-fb83-4a74-a946-320a10e9a064 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.239918 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.250231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.251587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.252186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.252469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.253351 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:01.254016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.255526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.259923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.260597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.260886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.261164 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.261879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:01.262191 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.263594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.273320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 476/942] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:01.273320 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.273535 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 467/943] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:01.274366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.292512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.397589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562fd45-f75a-4904-a356-ad761c4f38be None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.417079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8867-1d2e-45a0-8ec9-e30e33c8e4a3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.437203 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.438260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.438637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.439035 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.450716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.452385 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.462908 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.464630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.465190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.465559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.466317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.469254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:01.474004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:01.474934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:01.475853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:01.475853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:01.475853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:01.475853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:01.475853 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 477/944] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:01.483230 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.499312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 468/945] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:45:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:01.532101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.608490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f69e6-a2e5-4d99-8564-80821f956a96 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.663099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.663851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.664134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.664412 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.665156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:01.665469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.666971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.680581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 478/946] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:01.686054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.755712 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.793113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee27133-00ea-41f5-ba57-dbcf198d41f6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:01.828356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:01.829231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:01.829520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:01.829803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:01.836913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:01.838372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:01.852676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:01.853594 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:01.854474 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 469/947] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:01.861621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:01.954710 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:01.968887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95276d20-7836-4687-8548-84ebcc19255d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.007069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.007687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.007944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.008204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.009013 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:02.009322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.010832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1109b-366a-4feb-b36e-48f404c5d4f3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.025711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 479/948] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:02.031658 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:02.145153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eebdb-f65d-4f14-abec-5482ee2ba6f4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.172117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:02.175908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb660-77ad-4e18-afb3-f4a103804422 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.176203 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb660-77ad-4e18-afb3-f4a103804422 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.176486 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bb660-77ad-4e18-afb3-f4a103804422 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.179221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 480/949] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:02.182490 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.183162 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.183427 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.183546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.183700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.183798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.183975 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d30d379aa2c74f81846bf50c049610ac/roles/04ac5d337a4c4237b040d62662680190` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.186580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=d30d379aa2c74f81846bf50c049610ac, role_id=04ac5d337a4c4237b040d62662680190)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.188114 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.200529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:02.202067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:02.207126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 470/950] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:45:02 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d30d379aa2c74f81846bf50c049610ac/roles/04ac5d337a4c4237b040d62662680190 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:45:02.282545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 481/951] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:02.305531 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:02.431150 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc967-be84-43e4-910e-aa0897c6d7c9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.466938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.467795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.468079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.468357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.469019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.470409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:02.483018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:02.484182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:02.485079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:02.488086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 471/952] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:45:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:02.490772 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:02.568828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:02.593770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd7ca8-703f-44e3-8557-0ad02e29bde5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.629745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.630446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.630766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.631050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.631787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:02.632103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.633556 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.639754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 482/953] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:02.645308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:02.709376 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:02.762532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d617-b33f-43be-9fa3-b175a10b2a46 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.797064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.797737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.798026 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.798307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.799052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:02.799369 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.800758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417366d-c16f-4d13-9980-32f38bdb1f5c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.806209 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 472/954] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:02.811842 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:02.910739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f52e7b-dd6e-48ac-92d9-aa2bc227f141 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:02.945233 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:02.945903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:02.946191 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:02.946471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:02.947273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:02.948648 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eed441-af86-4de4-ac96-2b4dfe8c0f2f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:02.966531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:02.973028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 483/955] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:45:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:03.767174 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015be66b-e848-4ce1-b185-987a7f076f28 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:03.767707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015be66b-e848-4ce1-b185-987a7f076f28 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:03.767785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015be66b-e848-4ce1-b185-987a7f076f28 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:03.769374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 473/956] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:03.770889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb47f64-feaa-4a96-9ed1-8cccce1c52c9 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:03.771267 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb47f64-feaa-4a96-9ed1-8cccce1c52c9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:03.771462 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb47f64-feaa-4a96-9ed1-8cccce1c52c9 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:03.773074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 484/957] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:03.774334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:03.774623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:03.774928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:03.778009 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:03.778287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:03.778570 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:03.792096 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:03.793291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:03.795496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:03.796650 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:03.870151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 474/958] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:03.877875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 485/959] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:03.893027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:03.907543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:03.937408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:03.999198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590434a-2466-4480-8c4c-5ccfd7069bb4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.034614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.034882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af557a4f-45ed-47a5-8930-e26f8cb6b266 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.035929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.036411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.036891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.037752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.039446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:04.057477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:04.058558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:04.059441 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:04.062842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 475/960] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:04.065704 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.068185 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:04.077712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.078897 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.079396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.079894 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.080905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.082745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.098399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.sql.core [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:45:04.098399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:45:04.098399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [parameters: {'user_id': '3034013d020b408798c9759fb3f31b67', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:45:04.098399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80283) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application conn.query(q) May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result.read() May 19 19:45:04.108887 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:45:04.110344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application next(self.gen) May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application yield resource May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application next(self.gen) May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise self.value May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application session.commit() May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:45:04.111379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.session.flush() May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application compat.raise_( May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:45:04.112305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:45:04.113218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application conn.query(q) May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application result.read() May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:45:04.114077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [parameters: {'user_id': '3034013d020b408798c9759fb3f31b67', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:04.116181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 19:45:04.118066 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:45:04.120274 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.123251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 486/961] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:45:03 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:04.128966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.190389 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672fae-7be2-4911-8552-2c29fe3e2aec None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.194097 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:04.235980 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.237013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.237608 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.238379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.239625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:04.240136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.242436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.248068 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd823aa-33e3-48d2-b45b-0df1bb249e3c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.249304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 476/962] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:04.255016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.284527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.285715 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.286177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.286624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.294979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.297120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:04.312102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:04.313081 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:45:04.314070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:04.316822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 487/963] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:04.322495 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.380565 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896424-366a-4185-b762-c83c9236b44b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.386581 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:04.427508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.428206 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.428493 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.428777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.429516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:04.430325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.432464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712ad91-2ea7-4a43-ad3e-cc15732a4d30 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.446818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 477/964] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:04.460828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb82e-b18f-445e-914c-02c4630f9c66 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.498465 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.499222 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.499509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.499785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.500620 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:04.500931 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:04.502498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dca53-bace-4777-a62c-3f7b7af66f31 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:04.544891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 488/965] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:04.599702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6f1a-7cce-44d0-ace0-64fc974a1982 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.600035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6f1a-7cce-44d0-ace0-64fc974a1982 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.600272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6f1a-7cce-44d0-ace0-64fc974a1982 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.602022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 478/966] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:04.609264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.609600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.609836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.628799 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:04.630450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:04.712042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 489/967] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:04.735571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6f1a-7cce-44d0-ace0-64fc974a1982 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.770788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:04.847303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6f1a-7cce-44d0-ace0-64fc974a1982 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:04.882942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:04.884156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:04.884584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:04.885013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:04.896248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:04.904526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:04.905642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:04.906737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:04.908819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 479/968] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:04.914888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:04.956867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.018779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cba1c-4835-430a-92ea-95a9c7b2158c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.058886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.059580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.059867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.060144 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.060993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:05.061308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.062743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1891eddd-97de-45b4-b07c-d2c71018f624 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.071959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 490/969] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:05.077452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.169169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.179251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719b43-5e02-4045-8779-1158388a9124 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.213543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.214347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.214629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.214923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.220534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292031b2-e989-4e9d-94bb-6ac0cc69c532 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.220833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292031b2-e989-4e9d-94bb-6ac0cc69c532 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.221116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292031b2-e989-4e9d-94bb-6ac0cc69c532 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.222639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 491/970] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:05.225703 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.227571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.227695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.227999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.228237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.245356 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:05.245826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:05.246751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:05.247659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:05.247659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:05.247659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:05.247659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:05.247881 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:05.251018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 480/971] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:05.252540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.317527 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 492/972] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:05.343888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.358605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b38-0d0a-4362-b82d-b315e1dfafcf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.375766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.396132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.396788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.397072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.397370 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.398072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:05.398462 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.399794 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.416473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 481/973] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:05.417863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.423622 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.453508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2a36f-9b3c-4a36-a4c3-133057c09054 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.488189 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.489231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.489507 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.489793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.490456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.491894 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:05.504042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:05.505043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:05.505956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 493/974] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:05.511339 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.527994 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db477d8f-e536-4975-b3f3-308645f9d19c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.565260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.566091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.566852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.567140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.574583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.576023 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:05.591538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:05.592904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:05.593888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 482/975] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:05.598639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.617888 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.627167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c4621-6c79-4d7e-8928-8bc4c24cc6da None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.672812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.673343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.674461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.674925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.675328 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.676092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:05.676404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.678210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.684521 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 494/976] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:05.690011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.715375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf0d4c-aa13-4af9-b88e-f0dfdfbe89fc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.752883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.753573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.753862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.754143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.755025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:05.755348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.756799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.775038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 483/977] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:05.781059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.795340 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d11408-c2a8-4579-9057-a1ffb5d212ad None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.838116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.839630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.840157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.840585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.842120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:05.842724 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:05.844597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:05.851496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 495/978] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:05.857174 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:05.885963 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.886214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20953570-8d30-4177-aaef-c084e79e2cc3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:05.913913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:05.927041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:05.927935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:05.928430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:05.928885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:05.963847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495053c4-221b-427c-ad4a-b676baf7f0ed None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.000200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.001012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.001321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.001510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.001612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.002395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] RBAC: Adding query filter params (interface=admin, service_id=0f49378bf06349fa98760c96bfd94aa2, region_id=RegionOne) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:06.002739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.002987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.004113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.014724 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 496/979] 10.222.0.77 () {56 vars in 1249 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/endpoints?service_id=0f49378bf06349fa98760c96bfd94aa2&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:06.015561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.106855 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.108801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 484/980] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:06.114547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.123390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95c160-245a-435f-9966-d325b2bd8360 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.139715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.158075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.158773 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.159058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.159335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.160158 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.161662 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.168617 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 497/981] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:45:06.229075 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910ffe-9661-402f-9884-bee6a1f7eeb6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.269614 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.270435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.270781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.271073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.282738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.284240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:06.304301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:06.305297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:06.311078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:06.311078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:06.311078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:06.311078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:06.311078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 485/982] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:06.311667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.420050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e67bbd-8c32-4cfe-835f-1ac212d285fc None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.454434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.455132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.455460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.455838 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.456557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:06.456874 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.458264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.474250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 498/983] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:06.479682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.562741 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.590848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33982c-61ec-407c-a208-95f7150fbc9a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.625663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.626461 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.626772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.627054 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.633922 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.635422 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-34bb7cef-bdc5-4654-987a-62d9afc1cf51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:06.650725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:06.651675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:06.652671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:06.657259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 486/984] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:06.657390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.670727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.698240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671543-77ba-49c8-9d37-ec607ef4b4a5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.698517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671543-77ba-49c8-9d37-ec607ef4b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.698851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33671543-77ba-49c8-9d37-ec607ef4b4a5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.702746 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 487/985] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:06.705445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.706047 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.706047 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.723677 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:06.724917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:06.768338 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7534d-4a70-49a0-8e6a-ca2cdffefe2b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.798356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 488/986] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:06.803916 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.804589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.804985 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.805270 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.806064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:06.806379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.807870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.823999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 499/987] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:06.824174 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.825571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:06.890492 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.898092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:06.931104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ede9f4-78f0-4d9a-803e-db8490fda68c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.931285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9fe7e-103f-4e6a-916c-6024defd0c3a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:06.966867 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.967557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.967848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.968132 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.968654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:06.968973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] RBAC: Adding query filter params (role.id=04ac5d337a4c4237b040d62662680190, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d30d379aa2c74f81846bf50c049610ac) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:06.969290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.970029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:06.970514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:06.970750 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bd28f-eaae-42fe-a55e-72d321a40631 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.971192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:06.972127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:06.973692 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efcb06-5478-4acd-b300-dc03123e75b0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:06.976870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 500/988] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:06 2022] GET /identity/v3/role_assignments?user.id=d30d379aa2c74f81846bf50c049610ac&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=04ac5d337a4c4237b040d62662680190 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:06.995835 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 489/989] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:45:06 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:45:08.381149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019878f9-003b-451f-b41b-9ca298d5d4a6 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:08.381692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019878f9-003b-451f-b41b-9ca298d5d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:08.381692 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019878f9-003b-451f-b41b-9ca298d5d4a6 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:08.383084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 501/990] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:08.388593 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:08.389057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:08.389240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:08.405900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:08.407116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:08.485303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 490/991] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:08.507458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019878f9-003b-451f-b41b-9ca298d5d4a6 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:08.615409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019878f9-003b-451f-b41b-9ca298d5d4a6 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:08.659559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:08.660397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:08.660687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:08.660967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:08.661635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:08.663052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:08.665284 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:08.676801 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:08.677821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:45:08.678659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:08.683038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 502/992] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:45:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:08.684144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:08.737459 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:08.790379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e0c5d-bda1-487e-a603-33bb3f57d193 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:08.824771 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:08.825445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:08.825734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:08.826013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:08.826798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:08.827112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:08.828500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:08.833584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 491/993] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:08.839146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:08.939435 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d033c1f-f4aa-4c53-a915-cbbc465575d1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:08.973165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:08.973838 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:08.974122 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:08.974400 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:08.975151 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:08.975462 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:08.976841 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba41fc-593e-493b-b4d1-cb403777261c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:08.982409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 503/994] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:45:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:08.987991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.099063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4cd5-adea-4e52-92d2-b925332cab7f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.114926 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.137259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.137923 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.138213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.138491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.139341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.140728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ed368-6675-4458-90bf-5be2c6913f11 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.156384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 492/995] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:45:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:09.223697 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5520-da89-4774-96b4-421d0585c7d1 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.224011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5520-da89-4774-96b4-421d0585c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.224188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a5520-da89-4774-96b4-421d0585c7d1 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.225749 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 504/996] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:09.232169 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.232432 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.232751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.237910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad5ba-3e02-4069-bbca-894c00048210 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.238204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad5ba-3e02-4069-bbca-894c00048210 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.238490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ad5ba-3e02-4069-bbca-894c00048210 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.240082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 505/997] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:09.245787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.246080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.246352 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.251734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:09.252989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:09.263953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:09.265524 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:09.330591 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.339165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 493/998] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:09.344789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 506/999] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:09.361988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.368685 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.470696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a1fdd-8872-4835-a15a-9d3a56a22b80 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.479255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.483772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6477432-9447-4a45-a625-cfdccef72eca None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.508789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.509590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.509879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.510156 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] PATH_INFO: `/v3/services/image` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.510847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.512291 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.519266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.520067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.520350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.520632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.521288 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.522664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:09.523860 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:09.524813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:09.525663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 507/1000] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:09.531304 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:09.540166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:09.541190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:09.547305 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 494/1001] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:09.548118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.592365 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.640059 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fb4-8c51-4a0d-acdf-026748d5b739 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.666991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91568ea9-c427-4b5e-9434-11f09418ff5c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.679359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.680276 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.680708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.681133 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.681983 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] RBAC: Adding query filter params (name=image) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:09.682297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.683690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.689041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 508/1002] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:09.694120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.714552 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.715265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.715551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.715830 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.716543 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:09.716899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.718290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.723344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 495/1003] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:09.728866 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:09.760318 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.803229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc46aa-aaab-4fd6-aa17-72e085210664 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.825039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:09.839892 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.840804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.841226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.841365 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e3f15-8f09-4f8a-abf3-e32109d1e751 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:09.841766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.842636 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] RBAC: Adding query filter params (type=image) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:09.843125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.844740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.849571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 509/1004] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:09.887868 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:09.888564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:09.888921 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:09.889282 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:09.889925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:09.890237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:09.891799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:09.898095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 496/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:09.903981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:10.019444 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96020672-2604-44a3-b217-ae40c1089d93 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:10.055630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:10.056300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:10.056635 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:10.056864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:10.057652 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] RBAC: Adding query filter params (interface=public, service_id=5ac078be775144cfb3f1c70c7724370d, region_id=RegionOne) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:10.057968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:10.059403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c3fb3-9b70-4fe5-933d-a766cbb92db9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:10.064572 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 510/1006] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:45:09 2022] GET /identity/v3/endpoints?service_id=5ac078be775144cfb3f1c70c7724370d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:10.070435 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:10.165680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:10.175702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc06d1-e981-4e07-b142-b350875ee107 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:10.210722 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:10.211463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:10.211763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:10.212039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:10.212731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:10.214171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4df6d-169a-4c3c-99d7-04878392fc82 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:10.221728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 497/1007] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:45:10 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:45:11.379229 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830611-13a6-4792-95bd-0b25aa2fde96 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:11.379779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830611-13a6-4792-95bd-0b25aa2fde96 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:11.379779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830611-13a6-4792-95bd-0b25aa2fde96 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:11.382729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 511/1008] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:11.386583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:11.387018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:11.387204 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:11.404988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:11.406186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:11.480047 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 498/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:11.503182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830611-13a6-4792-95bd-0b25aa2fde96 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:11.557112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:11.612693 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830611-13a6-4792-95bd-0b25aa2fde96 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:11.654479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:11.654479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:11.654479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:11.654479 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:11.655147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:11.656731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080f4a5-6ed9-4ef4-b215-7fe9b624a904 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:11.658656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 512/1010] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:11.664932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:11.752420 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:11.769382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee5156-2643-4acb-956c-bd8de880e9c6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:11.804453 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:11.805171 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:11.805463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:11.805743 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:11.806446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:11.808240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e472d-07b1-4fbb-9cb1-ef8f8b877fc4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:11.842713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 499/1011] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:45:11 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:12.056245 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701ac1-acfc-4894-bc66-1e0584b7262f None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.056472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701ac1-acfc-4894-bc66-1e0584b7262f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.056747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701ac1-acfc-4894-bc66-1e0584b7262f None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.058271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 513/1012] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:12.064896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00866-789f-4aac-b614-da89681ae953 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.064896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00866-789f-4aac-b614-da89681ae953 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.064896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa00866-789f-4aac-b614-da89681ae953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.081832 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2fa00866-789f-4aac-b614-da89681ae953 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:12.083093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2fa00866-789f-4aac-b614-da89681ae953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:12.154723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 500/1013] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:12.177126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701ac1-acfc-4894-bc66-1e0584b7262f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:12.293900 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701ac1-acfc-4894-bc66-1e0584b7262f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:12.310605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:12.330124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:12.330828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.331114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.331391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.332122 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:12.333511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a992-b64b-420b-9c86-7649aa55fd83 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:12.348936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 514/1014] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:45:12 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:45:12.424943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60fc6-3712-461d-a3d8-5f6611eed26a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.425467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60fc6-3712-461d-a3d8-5f6611eed26a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.425467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60fc6-3712-461d-a3d8-5f6611eed26a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.427133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 501/1015] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:12.433088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.433659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.433659 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.451769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:12.453025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:12.535916 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 515/1016] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:12.558430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d60fc6-3712-461d-a3d8-5f6611eed26a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:12.630858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:12.679810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d60fc6-3712-461d-a3d8-5f6611eed26a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:12.715532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:12.716338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.716625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.716990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.717658 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:12.719107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:12.731375 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:12.732386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:12.733244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 502/1017] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:12.738968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:12.837207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d039b6d-b004-4e80-81de-f4acdd6bd5f4 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:12.838727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:12.874528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:12.875227 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:12.875515 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:12.875792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:12.876497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:12.876815 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:12.878206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:12.883480 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 516/1018] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:12.889104 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:12.990782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a588d9-3c70-4cc7-a8fa-27a65da0c96a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:13.021464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:13.029715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:13.030393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:13.030679 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:13.030963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:13.031702 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:13.032012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:13.033398 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e59384-dc5f-4091-940b-514d22cfc8ed None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:13.038596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 503/1019] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:45:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:13.044175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:13.152948 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1993869-b20c-4517-b12b-3a6ea24dd62c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:13.188690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:13.189366 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:13.189649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:13.189928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:13.190706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:13.192084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3c259-3842-44d0-b1f9-503b8baa5374 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:13.218721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 517/1020] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:45:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:45:14.091842 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56c9e-4018-450b-abcf-6b64a9277fe8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.092356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56c9e-4018-450b-abcf-6b64a9277fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.092356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56c9e-4018-450b-abcf-6b64a9277fe8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.093617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 504/1021] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:14.099542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.099992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.100099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.117343 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:14.118541 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:14.136536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:14.196053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 518/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:14.220370 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56c9e-4018-450b-abcf-6b64a9277fe8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:14.323183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c56c9e-4018-450b-abcf-6b64a9277fe8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:14.357013 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:14.357792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.358078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.358350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.359533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:14.360973 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3ed31-0270-46be-a798-9084e8d2e983 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:14.362740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 505/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:14.368439 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:14.475596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2279c2-ae26-4eb5-a091-71b192268ec6 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:14.511170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:14.511854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.512136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.512409 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.513112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:14.514643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746849-2647-4638-9272-d10b67618b0f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:14.536098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 519/1024] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:45:14 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:14.585552 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db350f76-a03c-4d07-899b-af0e7689a004 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.585885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db350f76-a03c-4d07-899b-af0e7689a004 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.586126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db350f76-a03c-4d07-899b-af0e7689a004 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.587569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 506/1025] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:14.593417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.593747 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.594001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.600497 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:14.613690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:14.614858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:14.702072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 520/1026] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:14.724916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db350f76-a03c-4d07-899b-af0e7689a004 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:14.795670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:14.838178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db350f76-a03c-4d07-899b-af0e7689a004 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:14.872781 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:14.873556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:14.873839 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:14.874112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] PATH_INFO: `/v3/services/image` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:14.874797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:14.876184 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:14.888041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:14.889126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:14.890015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 507/1027] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:45:14 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:14.895391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.001907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d578-0e98-421b-a14c-1e2169c4c390 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.038323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.039018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.039305 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.039547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.040290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] RBAC: Adding query filter params (name=image) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:15.040633 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:15.041975 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:15.043048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:15.053271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 521/1028] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:15.054557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.159250 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd5c3f-a2b7-4402-8f3f-6fad86be6f23 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.186424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:15.195930 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.196605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.196890 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.197165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.197870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:15.198178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:15.199584 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:15.204638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 508/1029] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:15.210240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.308776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f413b-5cc1-420c-a76b-ff8b2d2863fe None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.345743 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.346429 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.346727 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.347018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.347828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] RBAC: Adding query filter params (interface=public, service_id=d11748efd32048c9a28c6d2591e1296b, region_id=RegionOne) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:15.348125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:15.349534 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79e955-31e5-4d2b-81e9-24ee32960854 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:15.355875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 522/1030] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/endpoints?service_id=d11748efd32048c9a28c6d2591e1296b&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:15.361314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.463071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d843-364d-45b5-96a9-fd2981a23ff0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.498224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.498936 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.499223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.499499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.500187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:15.501558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64285536-b69c-4084-a9ce-4f4d8e1ae163 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:15.507311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef2ac5-59ea-44c7-92cd-12604288a637 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.507606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef2ac5-59ea-44c7-92cd-12604288a637 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.507886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef2ac5-59ea-44c7-92cd-12604288a637 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.513248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 509/1031] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:45:15.513448 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 523/1032] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:15.514863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.515160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.515444 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.533234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:15.534469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:15.590522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:15.614058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 510/1033] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:15.634642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef2ac5-59ea-44c7-92cd-12604288a637 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.709548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:15.753072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef2ac5-59ea-44c7-92cd-12604288a637 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.787643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.788469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.788760 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.789001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.800025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:15.808580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:15.809544 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:15.810579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 524/1034] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:15.817663 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:15.918439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70190dc4-93ed-440a-b6f8-3382803be01a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:15.952512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:15.953190 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:15.953532 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:15.953731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:15.954490 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:15.954837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:15.956214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:15.964477 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 511/1035] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:15.970172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:16.076639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b0bcf-b8f5-4707-9289-d379259b61cf None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:16.099487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:16.112696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:16.113495 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.113776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.114049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.124622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:16.126111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:16.143092 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:16.144020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:16.149758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:16.149758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:16.149758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:16.149758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:16.149758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 525/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:16.151854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:16.206942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:16.261352 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0b72-f6db-4370-8bfa-8ae687f06a4c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:16.295180 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:16.295847 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.296133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.296407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.297133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:16.297442 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:16.298851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:16.314762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 512/1037] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:16.316821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:16.425553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff66a9e-1bc2-4f4f-b5dd-d70550d842d6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:16.461965 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:16.462812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.463099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.463373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.471145 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:16.472610 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:16.486792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:16.487733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:16.493696 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 526/1038] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:45:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:16.495850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:16.596856 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741fe04-b14a-40b5-bb0f-610b415e44ce None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:16.606546 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:16.633513 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:16.634216 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.634501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.634813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.635676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:16.635993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:16.637491 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ebcbe-bc50-4de8-b884-27cf96bd7055 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:16.661909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 513/1039] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:45:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:16.667964 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:16.706350 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:16.786093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c3110-8996-4d8e-bcae-e73b2d9357c7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:16.820889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:16.821537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.821813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.822088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.822967 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef771-c09b-4c0d-9728-2971c1d1ac31 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.823262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef771-c09b-4c0d-9728-2971c1d1ac31 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.823544 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef771-c09b-4c0d-9728-2971c1d1ac31 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.825063 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 514/1040] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:16.829963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:16.830253 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:16.830534 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:16.847447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:16.848649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:16.891359 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:16.893151 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:16.922382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 515/1041] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:16.934491 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:16.946249 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.005446 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 527/1042] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:17.011014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.044669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.052446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc70e5-2324-419f-b359-f9e9078b007d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.087523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.088472 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.088760 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.089035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.101803 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:17.110285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:17.111436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:17.112429 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:17.114888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 516/1043] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:17.116407 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab3a9-6d82-43b2-9583-3518eee456e9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.120445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.157344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.158149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.158433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.158762 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.160858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.170190 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.171700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:17.190593 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:17.191780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:17.192722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:17.192722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:17.192722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:17.192722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:17.192722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 528/1044] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:17.197891 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.233354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd210-7f6e-450b-b0fd-472b4481c62c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.269191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.269821 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.270092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.270372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.271167 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:17.271480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.272898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.286445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 517/1045] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:17.287898 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.304013 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc6bb-2a94-4a56-bd04-53e78c955b8e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.307913 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.341925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.343326 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.343827 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.344172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.344982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:17.345294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.346671 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.359082 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 529/1046] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:17.364325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.395347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec5991-a0b6-4231-a6ff-d0d6c96fc88e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.416090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.431653 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.432539 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.432831 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.433108 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] PATH_INFO: `/v3/users/7295972b85c94ffc88dafa3ad5eebaa2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.447287 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] RBAC: Authorizing `identity:get_user(user_id=7295972b85c94ffc88dafa3ad5eebaa2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.448751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.450449 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 518/1047] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/users/7295972b85c94ffc88dafa3ad5eebaa2 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:17.456071 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.475731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6294bc-073b-46dc-bb1d-cb60ac699d29 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.513260 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.514488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.515001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.515498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.522909 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.524651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.536029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:17.539265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:17.540176 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:17.541080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 530/1048] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:17.546309 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.564324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a4733-5bc1-4567-8e7d-4c26f1547e43 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.602952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.603735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.604021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.604300 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.652625 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb31b2-38bc-4423-8945-46ee2a28d8f9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.660718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.683915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.686015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30147e-d5f3-4205-a9d2-a90ec7dade1b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.692194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.692873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.693160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.693435 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.694231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:17.694549 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.696013 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.708282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 531/1049] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:17.714007 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.768936 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.792564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 519/1050] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:45:17.793879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267ed03-929a-489e-a9e4-a749f94c6c43 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.794181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267ed03-929a-489e-a9e4-a749f94c6c43 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.794518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267ed03-929a-489e-a9e4-a749f94c6c43 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.795824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 520/1051] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:17.798095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267ed03-929a-489e-a9e4-a749f94c6c43 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.819716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471b17e-62bf-4d08-a895-9273e09ff938 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.852852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.853529 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.853819 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.854095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.854973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] RBAC: Adding query filter params (role.id=04ac5d337a4c4237b040d62662680190, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:17.855641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.857086 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7c95-7b5f-4f54-8272-a35f492f5d1b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.862513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 532/1052] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=04ac5d337a4c4237b040d62662680190 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:17.863707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.864348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.864348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.894954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:17.896404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:17.903766 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267ed03-929a-489e-a9e4-a749f94c6c43 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:17.927556 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:17.944051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:17.945322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:17.945799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:17.946266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:17.947823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:17.949560 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:17.951482 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 521/1053] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:17.957819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:17.981234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 533/1054] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:18.004365 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:18.010090 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:18.071657 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391e94c-2715-4854-b7cc-b22e6bb74ef7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:18.107597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:18.108527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:18.108995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:18.109276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:18.110108 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=00b0adf71e344875b2eaec98605095c7, user.id=7295972b85c94ffc88dafa3ad5eebaa2) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:18.110421 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:18.111901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:18.114767 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005ccc-bafa-4d93-80a4-e2a1c4075c9f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:18.118739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 522/1055] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:17 2022] GET /identity/v3/role_assignments?user.id=7295972b85c94ffc88dafa3ad5eebaa2&scope.project.id=00b0adf71e344875b2eaec98605095c7&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:18.161586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:18.162394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:18.162674 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:18.162993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] PATH_INFO: `/v3/services/image` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:18.163649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:18.165059 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:18.177992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:18.179170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:45:18.180110 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:18.181627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 534/1056] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:45:18 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:18.185907 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:18.296408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1a1e6-e678-483d-b7be-17ffe597d399 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:18.306460 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:18.336039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695068a0-854e-43a3-8167-a904faad413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:18.336621 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695068a0-854e-43a3-8167-a904faad413f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:18.336901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695068a0-854e-43a3-8167-a904faad413f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:18.337175 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695068a0-854e-43a3-8167-a904faad413f None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:18.337880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695068a0-854e-43a3-8167-a904faad413f None admin] RBAC: Adding query filter params (name=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:18.338185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695068a0-854e-43a3-8167-a904faad413f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:18.339618 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695068a0-854e-43a3-8167-a904faad413f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:18.344892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 523/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:18.350966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:18.378545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:18.464108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da055c-1a65-4b2b-81e8-5265bb73543e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:18.499773 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:18.500812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:18.501297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:18.501780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:18.502712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] RBAC: Adding query filter params (type=image) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:18.503239 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:18.504829 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d66f54-8945-47a6-bfff-fa0c39bae190 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:18.514594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 535/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:18.516131 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695068a0-854e-43a3-8167-a904faad413f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:18.624111 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695068a0-854e-43a3-8167-a904faad413f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:18.664210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:18.664878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:18.665159 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:18.665431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:18.666183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:18.667586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0f35-bc27-4e87-942b-65ea7de01052 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:18.690521 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 524/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:45:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:20.037388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3e53-e42f-4fee-b1bb-9e7842567941 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.037920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3e53-e42f-4fee-b1bb-9e7842567941 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.037920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3e53-e42f-4fee-b1bb-9e7842567941 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.039399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 536/1060] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:20.044600 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84905-3cf7-4c79-b651-ba4104903835 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.045012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84905-3cf7-4c79-b651-ba4104903835 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.045187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c84905-3cf7-4c79-b651-ba4104903835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.062717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-75c84905-3cf7-4c79-b651-ba4104903835 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:20.063891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-75c84905-3cf7-4c79-b651-ba4104903835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:20.088591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.145317 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 525/1061] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:20.167828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3e53-e42f-4fee-b1bb-9e7842567941 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.258440 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.272574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3e53-e42f-4fee-b1bb-9e7842567941 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.305580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.306313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.306589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.306890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.317897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6191f1-b8b4-4253-83ef-46ae8ef3ca68 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.318181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:20.318302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6191f1-b8b4-4253-83ef-46ae8ef3ca68 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.318466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6191f1-b8b4-4253-83ef-46ae8ef3ca68 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.320055 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 526/1062] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:20.324791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.325087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.325367 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:20.326499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:20.327494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:20.328332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:20.332648 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 537/1063] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:20.333406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.345396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:20.346707 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:20.422085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 527/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:20.435996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226442d8-3724-4154-96b6-7281fb9d47bf None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.444164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.473056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.473723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.474003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.474271 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.475052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:20.475355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:20.476729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:20.485487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 538/1065] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:20.490953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.502958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.537555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.554577 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48ff7-90d7-451b-bb63-1a16561b2868 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.592033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.592751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.593036 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.593315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.593412 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ced07-9d91-424a-8a45-d6159f387c92 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.604262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:20.612334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:20.613401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:20.615372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:20.618638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 528/1066] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:20.619625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.632542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.633387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.633655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.633932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.645504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:20.647445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:20.672483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:20.673424 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:20.674404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:20.674404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:20.674404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:20.674404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:20.674404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 539/1067] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:20.679512 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.732277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f64798-1293-4176-bfaa-1013e7aa54ea None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.745431 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.772484 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.773588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.773917 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.774198 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.774993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:20.775306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:20.777183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:20.788920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 529/1068] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:20.790598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409917f-f7e6-4a84-b989-2bb32a95d8de None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.796731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.806581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.831944 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.832618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.832905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.833184 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.833913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:20.834224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:20.835917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:20.856159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 540/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:20.857087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.914358 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75966e2d-0092-493a-aa81-2fab04bb2287 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.948801 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.949697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.949979 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.950258 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] PATH_INFO: `/v3/users/7295972b85c94ffc88dafa3ad5eebaa2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.951621 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] RBAC: Authorizing `identity:get_user(user_id=7295972b85c94ffc88dafa3ad5eebaa2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:20.953078 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4e6d3-ea6c-4837-a3a5-85037bca99cc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:20.954744 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 530/1070] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/users/7295972b85c94ffc88dafa3ad5eebaa2 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:20.955911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1c4-396e-49be-909b-01e5ccb150c1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.956199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1c4-396e-49be-909b-01e5ccb150c1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.956481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1c4-396e-49be-909b-01e5ccb150c1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:20.957939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 531/1071] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:20.960310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd1c4-396e-49be-909b-01e5ccb150c1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:20.962015 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497773e-23b1-43a6-94e4-03c91be60b55 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:20.984489 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:20.996127 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:20.996921 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:20.997202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:20.997474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.004646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.006087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-34a2e151-bef5-42f0-9704-cc0c776a4215 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:21.019919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:21.021098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:21.022101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 541/1072] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:21.022738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.023106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.023106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.039824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:21.040990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:21.043770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.071473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd1c4-396e-49be-909b-01e5ccb150c1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.106440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.107408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.107793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.108166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.109844 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.112000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.114144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 532/1073] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:20 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:21.114937 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.117890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 542/1074] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:21.120248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.219325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063def2-fc1f-40a8-b8f6-a1b9165ff5e1 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.221581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1bc6-a81c-485d-a4ef-565d529dad29 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.232770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.253911 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.254850 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.255129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.255324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.255436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7/users/7295972b85c94ffc88dafa3ad5eebaa2/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.256000 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.256288 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.256568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.257346 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b0adf71e344875b2eaec98605095c7, user_id=7295972b85c94ffc88dafa3ad5eebaa2, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.257457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:21.257897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.258814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.259405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.271898 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 543/1075] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:45:21 2022] PUT /identity/v3/projects/00b0adf71e344875b2eaec98605095c7/users/7295972b85c94ffc88dafa3ad5eebaa2/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:45:21.272740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.274715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.278858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 533/1076] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:21.284502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.397695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586fcaa-4181-4462-ae02-b3579056d509 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.397924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a096-e6ad-4a18-a615-8be31cb50e3c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.439763 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.440200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.440588 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.440700 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.440878 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.440974 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.441160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.441255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.459440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.461463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:21.481833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:21.482880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:21.483814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:21.483814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:21.483814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:21.483814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:21.483814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 534/1077] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:21.488912 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.489648 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.522770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.524579 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.543062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.592400 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955ce5-7a28-49b9-9f9b-9ef5b17c5ac6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.627852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.628869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.629330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.629623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.630353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:21.630671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.632116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.632840 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 544/1078] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:21.633663 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.649151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 535/1079] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:21.652509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.713398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.744416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa52d-7a01-46c5-8282-466700b9774b None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.764611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ecf96-0c77-4791-b309-860385bc3765 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.779330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.787459 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.788280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.788567 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.788849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.799408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.800936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.802353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.803276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.803625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.803969 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.810870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.812548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:21.819864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:21.820737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:21.821658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:21.821658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:21.821658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:21.821658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:21.821658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 545/1080] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:21.827405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:21.828518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:21.829409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:21.830346 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 536/1081] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:21.835624 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:21.934452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2677b1-a9f0-48d2-98c4-5e26f3bdaff8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.942961 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f2c1-77a7-4c89-8f62-70d13bd2be4d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:21.958294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:21.971877 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.972547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.972828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.973102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.973828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:21.974182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.975561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48af7d-4d39-4723-9ba1-d04e10f543c4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.978232 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:21.978925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:21.979210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:21.979485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:21.980580 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:21.980893 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:21.982378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:21.987399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 546/1082] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:21.999626 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 537/1083] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:22.000987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:22.036738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:22.124998 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7723ff-a5d9-4507-a689-e6477e5ebbe5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:22.164887 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:22.166187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:22.167374 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:22.167660 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/04ac5d337a4c4237b040d62662680190` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:22.170034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=973379ffb05f4e819502f1ede6635aff, role_id=04ac5d337a4c4237b040d62662680190)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:22.171541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699b170-9b32-4f06-b202-f5a2cc6ebeed None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:22.185353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 538/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:45:21 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/973379ffb05f4e819502f1ede6635aff/roles/04ac5d337a4c4237b040d62662680190 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:45:23.473907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a0ccb-b2a1-45e2-ba37-1e8f14dfc2e5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:23.474471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a0ccb-b2a1-45e2-ba37-1e8f14dfc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:23.474471 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a0ccb-b2a1-45e2-ba37-1e8f14dfc2e5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:23.475858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 547/1085] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:23.481510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:23.481940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:23.482133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:23.499283 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:23.500454 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:23.568322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 539/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:23.591486 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a0ccb-b2a1-45e2-ba37-1e8f14dfc2e5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:23.701128 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a0ccb-b2a1-45e2-ba37-1e8f14dfc2e5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:23.735627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:23.736350 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:23.736634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:23.736913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:23.748026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:23.755658 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:23.756616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:23.757701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 548/1087] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:23.763057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:23.787656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:23.867395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb7fc0-cff3-4b78-b2c7-f9c7bbbb124e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:23.902972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:23.903645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:23.904024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:23.904309 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:23.905068 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:23.905386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:23.906796 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:23.915300 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 540/1088] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:23.921165 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:23.967159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.021565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7268853-0109-48d6-a17f-6d14d53e5a06 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.056215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.057087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.057371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.057652 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] PATH_INFO: `/v3/users/7295972b85c94ffc88dafa3ad5eebaa2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.058925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7295972b85c94ffc88dafa3ad5eebaa2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.060401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be864-00b4-4926-91d3-b85d730534b8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.062254 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 549/1089] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:23 2022] GET /identity/v3/users/7295972b85c94ffc88dafa3ad5eebaa2 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:24.068084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.156234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.175154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86222-f44e-4081-b5c1-0d025e79c572 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.212091 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.212931 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.213681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.214962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.291360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.292747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.342355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbdbf-71ef-49ac-9915-8f99dcad96f5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.342639 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbdbf-71ef-49ac-9915-8f99dcad96f5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.342949 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cbdbf-71ef-49ac-9915-8f99dcad96f5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.344336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 550/1090] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:24.349263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.349616 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.349955 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.367058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:24.368361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:24.380798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.398693 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 541/1091] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:24.404728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.440569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 551/1092] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:45:24.463834 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.504121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbd12-b7fb-491d-876b-a7cc75f0a90c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.506587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.538297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.539193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.539480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.539757 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.540979 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.542481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.544344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 542/1093] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:24.550231 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.562170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56c0a4-1371-441a-b59d-563ae7afa60d None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.596257 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.597073 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.597361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.597641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.602526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.608298 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:24.616655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:24.617629 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:24.619604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 552/1094] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:24.623723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.651681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7149a7-6819-403b-8718-d28e33a6646d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.687941 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.688608 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.688896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.689176 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.690007 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=00b0adf71e344875b2eaec98605095c7, user.id=7295972b85c94ffc88dafa3ad5eebaa2) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:24.690322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.691810 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.697634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 543/1095] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/role_assignments?user.id=7295972b85c94ffc88dafa3ad5eebaa2&scope.project.id=00b0adf71e344875b2eaec98605095c7&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:24.736999 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6efaad-5d74-49f2-b147-c40234b8ae3f None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.738756 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.775540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.776252 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.776514 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.776794 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.777556 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:24.777871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.779484 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.788779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 553/1096] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:24.794807 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:24.906644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cb03-6ca7-46a7-af95-b5b36bd944b8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:24.923823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:24.942538 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:24.943389 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:24.943680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:24.943960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:24.953948 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:24.955447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:24.972551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:24.973440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:24.974368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:24.974368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:24.974368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:24.974368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:24.974812 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 544/1097] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:24.979820 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:25.086134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56edc3-a5ed-41e1-b143-080c501a7333 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:25.120837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:25.121490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:25.121782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:25.122062 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:25.122866 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:25.123181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:25.124548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:25.137050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 554/1098] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:25.142366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:25.242239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cc1f6-e68a-4ff0-a539-6c7b7bfd82a0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:25.276906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:25.277754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:25.278039 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:25.278310 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:25.285427 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:25.286906 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:45:25.301157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:25.302264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:25.304129 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 545/1099] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:45:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:25.308143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:25.334426 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:25.409859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6648-91e5-4d15-89ce-5d88fa00f22c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:25.444886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:25.445563 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:25.445875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:25.446125 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:25.447005 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:25.447319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:25.448765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:25.465927 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 555/1100] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:45:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:25.471920 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:25.501277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:25.582290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5220e-8034-4e21-a001-2e5e5d6c3f08 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:25.618506 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:25.619160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:25.619465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:25.619742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:25.687005 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:25.688412 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:25.715260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:25.790828 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 546/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:25.797310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:25.890707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:25.910996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8b0d5-43b3-46b5-9a15-af32eda6ec4c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:25.946316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:25.947074 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:25.947360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:25.947644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:25.957920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:25.959558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:25.978041 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:25.979178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:25.980450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:45:25.980450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:25.980450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:45:25.980450 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:25.982858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 556/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:45:25.985428 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:26.087156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f1bdf-0451-4e0c-b449-d0e48340c4c1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:26.114573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:26.123470 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:26.124136 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.124425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.124704 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.125434 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:26.125746 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:26.127156 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:26.138798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 547/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:26.144511 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:26.245555 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2894a-47d8-4f4e-bc90-718ce852e518 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:26.280864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:26.281667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.281952 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.282228 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.284147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:26.289738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:26.291432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:45:26.304812 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:26.305721 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:26.306621 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 557/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:26.311982 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:26.419540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdded9-ed3b-46d8-a3c7-807714ea9959 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:26.457817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:26.458479 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.458798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.459080 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.459901 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:26.460215 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:26.461666 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e103656-ce3d-4e81-b1ca-c77dee58712d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:26.473770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 548/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:26.480290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:26.585612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27426271-c058-4b36-bc7c-8332c21a2fdc None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:26.622883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:26.623548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.623835 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.624114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.624938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] RBAC: Adding query filter params (role.id=04ac5d337a4c4237b040d62662680190, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=973379ffb05f4e819502f1ede6635aff) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:26.625251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:26.626704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ba797-6d9a-45d9-b90c-b34ad89d830c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:26.632795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 558/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:26 2022] GET /identity/v3/role_assignments?user.id=973379ffb05f4e819502f1ede6635aff&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=04ac5d337a4c4237b040d62662680190 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:26.920869 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c733-9083-41cf-99c6-c705bbc0e46d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.921386 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c733-9083-41cf-99c6-c705bbc0e46d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.921496 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063c733-9083-41cf-99c6-c705bbc0e46d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.922825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 549/1107] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:26.928254 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:26.928690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:26.928835 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:26.945903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:26.947118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:27.002241 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:27.016595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 559/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:27.041524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063c733-9083-41cf-99c6-c705bbc0e46d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:27.094949 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:27.148226 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063c733-9083-41cf-99c6-c705bbc0e46d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:27.181919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:27.182656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:27.183062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:27.183337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:27.184528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:27.186012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e829-dbbf-406c-aa52-27e44f1f4820 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:27.187673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 550/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:27.193694 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:27.299093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30b72-5b0c-4061-853e-641cb56079ed None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:27.333111 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:27.333789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:27.334069 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:27.334341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:27.335209 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:27.336636 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636beea-7643-4f5f-a8bd-fb754d21fa6c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:27.357578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 560/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:45:27 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:29.593118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5008-401b-41b4-b6e4-4f6eac40e645 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:29.593776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5008-401b-41b4-b6e4-4f6eac40e645 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:29.593776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a5008-401b-41b4-b6e4-4f6eac40e645 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:29.595066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 551/1111] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:29.601422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:29.602121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:29.602289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:29.623302 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:29.624499 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:29.670316 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:29.699731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 561/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:29.723563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5008-401b-41b4-b6e4-4f6eac40e645 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:29.833290 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a5008-401b-41b4-b6e4-4f6eac40e645 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:29.851464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:29.875168 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:29.876024 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:29.876307 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:29.876583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] PATH_INFO: `/v3/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:29.878197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] RBAC: Authorizing `identity:get_role(role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:29.879649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:29.881020 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 552/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:29 2022] GET /identity/v3/roles/f4e416d654c94fa4b1fa935222bca067 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:29.887565 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:30.002060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc82b0b-2bf5-4dcc-8e8d-235a2f3acac8 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:30.042859 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:30.043737 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:30.044102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:30.044416 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] PATH_INFO: `/v3/users/2c157813ad8b495e85952eae8f905869` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:30.057875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] RBAC: Authorizing `identity:get_user(user_id=2c157813ad8b495e85952eae8f905869)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:30.059373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:30.061113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 562/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:29 2022] GET /identity/v3/users/2c157813ad8b495e85952eae8f905869 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:30.067993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:30.179894 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e21a-612a-4cfb-8651-034f60953d84 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:30.215489 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:30.216137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:30.216439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:30.216716 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:30.269932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:30.296185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:30.297656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:30.399988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 553/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:30.408996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:30.448374 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:30.531739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d764f-d1eb-4ecc-9ae3-42e49df120cf None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:30.568104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:30.568958 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:30.569248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:30.569520 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:30.570857 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:30.572293 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a904ac8-5f58-405f-b4f8-03a3b1db99ef None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:30.573995 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 563/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:30 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:30.580302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:30.670118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:30.688047 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e4fe-e4ae-45a6-8749-4c4ad2b14c27 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:30.722911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:30.723475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:30.723765 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:30.724066 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:30.724900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=00b0adf71e344875b2eaec98605095c7, user.id=2c157813ad8b495e85952eae8f905869) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:30.725214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:30.726749 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c748-7abe-43a2-8188-6ff1384617d1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:30.732734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 554/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:30 2022] GET /identity/v3/role_assignments?user.id=2c157813ad8b495e85952eae8f905869&scope.project.id=00b0adf71e344875b2eaec98605095c7&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:32.876679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f461a-8515-4ce4-9258-2826e82e953b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:32.877278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f461a-8515-4ce4-9258-2826e82e953b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:32.877278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f461a-8515-4ce4-9258-2826e82e953b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:32.878587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 564/1118] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:45:32.885056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:32.885789 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:32.885951 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:32.910706 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:32.911849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:32.983911 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 555/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:33.012019 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f461a-8515-4ce4-9258-2826e82e953b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:33.113322 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:33.118038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f461a-8515-4ce4-9258-2826e82e953b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:33.154120 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:33.154992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:33.155253 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:33.155528 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] PATH_INFO: `/v3/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:33.157020 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] RBAC: Authorizing `identity:get_role(role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:33.158391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:33.159805 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 565/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:33 2022] GET /identity/v3/roles/f4e416d654c94fa4b1fa935222bca067 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:33.165932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:33.246857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:33.271332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45164e3a-30a8-460d-83eb-9142ab305262 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:33.306918 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:33.307783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:33.308070 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:33.308348 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] PATH_INFO: `/v3/users/2c157813ad8b495e85952eae8f905869` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:33.309665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] RBAC: Authorizing `identity:get_user(user_id=2c157813ad8b495e85952eae8f905869)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:33.311158 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:33.312783 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 556/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:33 2022] GET /identity/v3/users/2c157813ad8b495e85952eae8f905869 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:33.318789 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:33.425196 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e640cb1-5068-464a-8291-1e26c6c5a026 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:33.465729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:33.466649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:33.466969 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:33.467247 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:33.468561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:33.470005 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ea71-f4f7-481c-83b2-c1a3552c6ef1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:33.471702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 566/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:33 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:33.480817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:33.594483 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e8732-b5a5-46fb-ad97-7a87f517ae49 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:33.630355 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:33.631234 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:33.631545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:33.631826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7/users/2c157813ad8b495e85952eae8f905869/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:33.634268 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] RBAC: Authorizing `identity:create_grant(project_id=00b0adf71e344875b2eaec98605095c7, user_id=2c157813ad8b495e85952eae8f905869, role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:33.635738 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2586339-2005-4efa-92d3-98fa297486be None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:33.651488 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 557/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:45:33 2022] PUT /identity/v3/projects/00b0adf71e344875b2eaec98605095c7/users/2c157813ad8b495e85952eae8f905869/roles/f4e416d654c94fa4b1fa935222bca067 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:45:35.813996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f19-6981-4718-b39a-5aa22fe595d8 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:35.814858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f19-6981-4718-b39a-5aa22fe595d8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:35.814858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27670f19-6981-4718-b39a-5aa22fe595d8 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:35.817099 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 567/1124] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:35.825793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:35.826233 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:35.826465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:35.843880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:35.850454 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:35.852109 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:35.921723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 558/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:35.950545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670f19-6981-4718-b39a-5aa22fe595d8 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:35.990071 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:36.055297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27670f19-6981-4718-b39a-5aa22fe595d8 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:36.089689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:36.090537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:36.090849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:36.091152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] PATH_INFO: `/v3/roles/f4e416d654c94fa4b1fa935222bca067` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:36.092662 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] RBAC: Authorizing `identity:get_role(role_id=f4e416d654c94fa4b1fa935222bca067)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:36.094035 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:36.095441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 568/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:35 2022] GET /identity/v3/roles/f4e416d654c94fa4b1fa935222bca067 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:36.104550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:36.209052 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9ffaf-0480-42f0-97db-81b035619c03 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:36.254883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:36.255767 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:36.256050 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:36.256320 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] PATH_INFO: `/v3/users/2c157813ad8b495e85952eae8f905869` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:36.258123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] RBAC: Authorizing `identity:get_user(user_id=2c157813ad8b495e85952eae8f905869)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:36.260436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:36.263092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 559/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:36 2022] GET /identity/v3/users/2c157813ad8b495e85952eae8f905869 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:36.272258 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:36.406204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea79c8-c772-43a6-885d-80eb01736fce None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:36.408554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:36.440367 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:36.441011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:36.441293 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:36.441569 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:36.507319 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:36.508681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:36.607960 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 569/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:36.617576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:36.623345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:36.730280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec006b-814a-4407-8a31-5b48ff4d83ac None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:36.771844 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:36.773046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:36.773406 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:36.773782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] PATH_INFO: `/v3/projects/00b0adf71e344875b2eaec98605095c7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:36.775747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] RBAC: Authorizing `identity:get_project(project_id=00b0adf71e344875b2eaec98605095c7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:36.778027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8267-7873-41b6-81d7-9783e0b0a15f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:36.780022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 560/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:36 2022] GET /identity/v3/projects/00b0adf71e344875b2eaec98605095c7 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:36.788546 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:36.791878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:36.890537 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb102a-a077-455b-85a8-681c6cd702f7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:36.925238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:36.925879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:36.926157 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:36.926412 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:36.927278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] RBAC: Adding query filter params (role.id=f4e416d654c94fa4b1fa935222bca067, scope.project.id=00b0adf71e344875b2eaec98605095c7, user.id=2c157813ad8b495e85952eae8f905869) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:36.927586 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:36.929004 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c082be-697f-4a5e-bcfe-57e6bc2c3139 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:36.934718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 570/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:36 2022] GET /identity/v3/role_assignments?user.id=2c157813ad8b495e85952eae8f905869&scope.project.id=00b0adf71e344875b2eaec98605095c7&role.id=f4e416d654c94fa4b1fa935222bca067 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:39.132528 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eef2-fd07-444d-ba38-3d6ac5e29e10 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:39.133399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eef2-fd07-444d-ba38-3d6ac5e29e10 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:39.133399 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eef2-fd07-444d-ba38-3d6ac5e29e10 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:39.135659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 561/1131] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:39.141195 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:39.141636 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:39.141738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:39.160206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:39.161405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:39.224864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:39.231553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 571/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:39.254894 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53eef2-fd07-444d-ba38-3d6ac5e29e10 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:39.334016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:39.375349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53eef2-fd07-444d-ba38-3d6ac5e29e10 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:39.410668 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:39.411427 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:39.411705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:39.411974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:39.413183 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:39.414630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6090e-8913-405b-9787-fe0bc216aa43 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:39.416254 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 562/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:39.422345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:39.523490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13ecd1-3a6c-4eb3-ac62-bc000a1a659f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:39.562605 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:39.563292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:39.563575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:39.563852 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:39.564555 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:39.565982 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64824f-a7ee-4ae7-9d9b-684ad7bd210f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:39.596145 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 572/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:45:39 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:41.827224 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4205f7-2fc4-436d-a89c-b4b716dc7009 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:41.827776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4205f7-2fc4-436d-a89c-b4b716dc7009 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:41.827776 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4205f7-2fc4-436d-a89c-b4b716dc7009 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:41.829130 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 563/1135] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:41.834678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:41.835115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:41.835221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:41.853824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:41.855361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:41.910149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:41.934397 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 573/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:41.959656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4205f7-2fc4-436d-a89c-b4b716dc7009 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:42.072770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4205f7-2fc4-436d-a89c-b4b716dc7009 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:42.120700 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:42.121504 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:42.121791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:42.122107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:42.123396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:42.124863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3780a9-3b10-4770-9ad0-206fabf4425f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:42.126536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 564/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:45:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:42.132437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:42.242390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1144b-8ffb-45c6-b1c3-97f0a2f10a63 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:42.280615 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:42.281276 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:42.281564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:42.281838 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:42.282584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:42.284129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366ee9e-0f39-4964-a4cb-058203f6220a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:42.307187 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 574/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:45:42 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:45:44.532467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1488-8267-4436-bc69-75105553237c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:44.533058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1488-8267-4436-bc69-75105553237c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:44.533058 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1488-8267-4436-bc69-75105553237c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:44.534551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 565/1139] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:44.540938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:44.541651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:44.541798 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:44.559908 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:44.561168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:44.594300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:44.636626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 575/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:44.672057 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1488-8267-4436-bc69-75105553237c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:44.687449 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:44.804787 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1488-8267-4436-bc69-75105553237c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:44.839717 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:44.840510 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:44.840843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:44.841107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:44.851393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:44.859325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:44.860430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:44.861617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 566/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:44.868317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:44.971691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a498-006c-472f-bd24-5d22b5ee2170 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:45.009829 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:45.010500 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:45.010816 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:45.011098 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:45.011858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:45.012171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:45.013672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:45.022523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 576/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:45.033418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:45.119006 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:45.154899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2d51-fe8b-478d-b41a-696dc9e0d5b2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:45.203599 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:45.204487 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:45.204772 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:45.205045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] PATH_INFO: `/v3/users/6887cc012c6f45f3ab648437812a8656` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:45.218924 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] RBAC: Authorizing `identity:get_user(user_id=6887cc012c6f45f3ab648437812a8656)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:45.220380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:45.222014 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 567/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:45 2022] GET /identity/v3/users/6887cc012c6f45f3ab648437812a8656 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:45.230914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:45.259703 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:45.347861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42a2b-d3b7-4e0c-97cd-3578c4ca11e8 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:45.382485 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:45.383172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:45.383464 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:45.383739 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:45.454035 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:45.455519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:45.482216 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:45.555936 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 577/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:45.562106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:45.665314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587533-62f0-4aed-a047-99f070aa9a02 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:45.691596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:45.702382 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:45.703276 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:45.703563 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:45.703848 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] PATH_INFO: `/v3/projects/b702162d90504694b1b851c9d503ef17` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:45.705081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] RBAC: Authorizing `identity:get_project(project_id=b702162d90504694b1b851c9d503ef17)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:45.706549 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b389d-b83e-40d2-8a51-e52351a7bee3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:45.708372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 568/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:45 2022] GET /identity/v3/projects/b702162d90504694b1b851c9d503ef17 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:45.714564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:45.820300 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a27566-81af-4ed3-b157-ac99f970cfa4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:45.847204 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:45.859100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:45.859752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:45.860038 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:45.860318 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:45.861152 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=b702162d90504694b1b851c9d503ef17, user.id=6887cc012c6f45f3ab648437812a8656) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:45.861469 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:45.862925 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f27023-255d-4957-b7d7-5e083f1b3ca8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:45.868559 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 578/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:45 2022] GET /identity/v3/role_assignments?user.id=6887cc012c6f45f3ab648437812a8656&scope.project.id=b702162d90504694b1b851c9d503ef17&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:48.021790 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e21-001f-43e4-b661-776f13cf6597 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.022601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e21-001f-43e4-b661-776f13cf6597 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.022601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66202e21-001f-43e4-b661-776f13cf6597 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.024767 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 569/1147] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:48.031341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.031780 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.031871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.058723 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:48.060234 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:48.149971 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 579/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:48.173819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66202e21-001f-43e4-b661-776f13cf6597 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:48.294841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66202e21-001f-43e4-b661-776f13cf6597 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:48.334537 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:48.335383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.335671 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.335947 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.346598 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:48.354191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:48.355607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:48.361359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 570/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:48.362244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:48.465283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f60e-b95d-4cca-8e13-4f4be8be0fa4 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:48.488979 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:48.502726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:48.503408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.503691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.503967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.504713 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:48.505019 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:48.506399 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:48.515403 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 580/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:45:48.525048 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:48.583272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:48.630044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171785c-b1a9-40ac-86bd-15b869e72703 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:48.664768 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:48.665656 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.665942 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.666222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] PATH_INFO: `/v3/users/6887cc012c6f45f3ab648437812a8656` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.667529 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] RBAC: Authorizing `identity:get_user(user_id=6887cc012c6f45f3ab648437812a8656)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:48.669301 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:48.670972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 571/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:48 2022] GET /identity/v3/users/6887cc012c6f45f3ab648437812a8656 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:48.676843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:48.784627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a2024-b328-4573-b444-c0bd4f09ff9c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:48.819006 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:48.819861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.820149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.820428 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] PATH_INFO: `/v3/projects/b702162d90504694b1b851c9d503ef17` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.821753 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] RBAC: Authorizing `identity:get_project(project_id=b702162d90504694b1b851c9d503ef17)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:48.823226 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a34dd1-121a-4863-be42-7915e0593602 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:48.824970 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 581/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:48 2022] GET /identity/v3/projects/b702162d90504694b1b851c9d503ef17 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:48.830935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:48.950147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc84ec-e804-4069-a064-ec6e314d8b91 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:48.971339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:48.984027 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:48.984919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:48.985202 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:48.985475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] PATH_INFO: `/v3/projects/b702162d90504694b1b851c9d503ef17/users/6887cc012c6f45f3ab648437812a8656/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:48.987718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] RBAC: Authorizing `identity:create_grant(project_id=b702162d90504694b1b851c9d503ef17, user_id=6887cc012c6f45f3ab648437812a8656, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:48.989160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3b464-1bf5-4f81-a8fc-6e0f53d1fe7b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:49.007140 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 572/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:45:48 2022] PUT /identity/v3/projects/b702162d90504694b1b851c9d503ef17/users/6887cc012c6f45f3ab648437812a8656/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:45:51.152273 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35abfa-e2ac-4412-9bb6-edaa8ed7cd42 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.153147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35abfa-e2ac-4412-9bb6-edaa8ed7cd42 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.153147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35abfa-e2ac-4412-9bb6-edaa8ed7cd42 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.155382 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 582/1154] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:51.161628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.162344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.162523 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.183439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:51.184659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:51.259012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 573/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:51.295900 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35abfa-e2ac-4412-9bb6-edaa8ed7cd42 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:51.363001 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:51.415115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35abfa-e2ac-4412-9bb6-edaa8ed7cd42 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:51.455634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:51.456400 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.456679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.456953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.467441 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:45:51.475026 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:51.476116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:45:51.477114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 583/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:51.484640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:51.585241 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5b228-3504-435c-be90-1ebc1433c26c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:51.598248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:51.624729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:51.625393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.625670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.625946 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.626732 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:51.627037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:51.628424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:51.636558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 574/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:51.642787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:51.746532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b595c-5e5c-4ae0-9cda-680c5fcb0ba7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:51.759512 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:51.783079 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:51.783953 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.784232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.784506 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] PATH_INFO: `/v3/users/6887cc012c6f45f3ab648437812a8656` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.785731 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] RBAC: Authorizing `identity:get_user(user_id=6887cc012c6f45f3ab648437812a8656)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:51.787255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:51.788884 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 584/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:45:51 2022] GET /identity/v3/users/6887cc012c6f45f3ab648437812a8656 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:51.795141 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:51.910888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460442c-6691-4a43-94ab-f57f9e0540f0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:51.945364 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:51.946010 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:51.946297 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:51.946573 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:51.989648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:52.018908 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:52.020298 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:52.119798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 575/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:52.125956 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:52.236237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7568c91-bbe1-48c3-8dc5-5f0a6bc50880 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:52.281522 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:52.286048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:52.286048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:52.286048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] PATH_INFO: `/v3/projects/b702162d90504694b1b851c9d503ef17` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:52.286048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b702162d90504694b1b851c9d503ef17)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:52.286048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1576f8-2e18-4c52-b8db-0718a4e806a6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:52.287622 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 585/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:45:52 2022] GET /identity/v3/projects/b702162d90504694b1b851c9d503ef17 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:52.293987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:52.377678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:52.403093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eaa27-106b-4810-b5ba-cdb0b65cd73e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:52.438083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:52.438714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:52.439041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:52.439312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:52.440138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=b702162d90504694b1b851c9d503ef17, user.id=6887cc012c6f45f3ab648437812a8656) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:52.440452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:52.441885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020017a4-a1c7-427f-90a8-10ed0c4d2791 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:52.447854 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 576/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:45:52 2022] GET /identity/v3/role_assignments?user.id=6887cc012c6f45f3ab648437812a8656&scope.project.id=b702162d90504694b1b851c9d503ef17&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:54.731832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64b628-13dc-42ba-90c1-0ed06245c844 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:54.733602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64b628-13dc-42ba-90c1-0ed06245c844 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:54.733602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64b628-13dc-42ba-90c1-0ed06245c844 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:54.733814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 586/1162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:54.739439 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:54.739824 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:54.740001 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:54.759590 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:54.760811 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:54.829912 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 577/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:54.852822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64b628-13dc-42ba-90c1-0ed06245c844 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:54.907119 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:54.962220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64b628-13dc-42ba-90c1-0ed06245c844 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:54.996872 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:54.997514 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:54.997805 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:54.998130 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:55.064332 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:55.065793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:55.113652 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:55.164212 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 587/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:45:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:45:55.170425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:55.244389 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:55.282186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f7fc6-1dc5-4ad4-bd22-6239f52a6418 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:55.317181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:55.317991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:55.318275 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:55.318547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:55.325518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:55.327116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-33d8801f-6705-478a-bd57-1f2b5ac74345 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:45:55.350324 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:45:55.351557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:45:55.352681 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 578/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:45:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:45:55.360225 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:55.463786 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d176b6-f213-4ab5-a36d-f9611f656988 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:55.497564 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:55.498231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:55.498516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:55.498950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:55.499687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:45:55.499996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:55.502017 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096740c-951e-4f09-8055-40e92fa52eff None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:55.509141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 588/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:45:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:45:57.721331 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c1d4-fbfb-4ca1-ab0e-021dedab5d14 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:57.722221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c1d4-fbfb-4ca1-ab0e-021dedab5d14 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:57.722221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c1d4-fbfb-4ca1-ab0e-021dedab5d14 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:57.724478 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 579/1167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:45:57.733536 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829f62-467d-4a2e-9d1b-c0d6897e164c None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:57.733970 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829f62-467d-4a2e-9d1b-c0d6897e164c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:57.734109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829f62-467d-4a2e-9d1b-c0d6897e164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:57.756422 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-78829f62-467d-4a2e-9d1b-c0d6897e164c None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:45:57.757604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-78829f62-467d-4a2e-9d1b-c0d6897e164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:45:57.764883 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:57.827423 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 589/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:45:57.862137 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c1d4-fbfb-4ca1-ab0e-021dedab5d14 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:45:57.984016 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c1d4-fbfb-4ca1-ab0e-021dedab5d14 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:45:58.009956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:45:58.019067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:45:58.019725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:45:58.020021 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:45:58.020303 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:45:58.021047 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:45:58.022436 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c33834-96e7-4d75-93a6-1a54d4143f18 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:45:58.038117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 580/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Thu May 19 19:45:57 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:46:00.306538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479df4-d03d-420e-8dc4-0ca8d6089b12 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:00.307478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479df4-d03d-420e-8dc4-0ca8d6089b12 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:00.307478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9479df4-d03d-420e-8dc4-0ca8d6089b12 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:00.309631 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 590/1170] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:00.317597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:00.318056 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:00.318165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:00.336680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:00.337838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:00.408403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 581/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:00.434821 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9479df4-d03d-420e-8dc4-0ca8d6089b12 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:00.544705 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9479df4-d03d-420e-8dc4-0ca8d6089b12 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:00.581127 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:00.581921 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:00.582207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:00.582484 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] PATH_INFO: `/v3/domains/af367482e6534eddb2c80c32a0f2302c` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:00.594310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=af367482e6534eddb2c80c32a0f2302c)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:00.595800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687e39-1540-48f5-b183-c392a0860b89 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:00.597433 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 591/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 19:46:00 2022] GET /identity/v3/domains/af367482e6534eddb2c80c32a0f2302c => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:00.606294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:00.721935 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3f81d-ad80-457d-ab96-c80a4f165a24 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:00.739638 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:00.758547 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:00.759235 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:00.759520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:00.759792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:00.760512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:00.761988 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c6a3-1b38-4519-a215-9b7e3ecd733c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:00.791414 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 582/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:46:00 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:46:03.007923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284206-eac8-4d7d-9ee9-c6ece66a9f8f None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:03.008766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284206-eac8-4d7d-9ee9-c6ece66a9f8f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:03.008766 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284206-eac8-4d7d-9ee9-c6ece66a9f8f None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:03.010864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 592/1174] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:46:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:03.016446 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:03.016892 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:03.016995 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:03.035186 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:03.036343 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:03.107958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 583/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:03.133335 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb284206-eac8-4d7d-9ee9-c6ece66a9f8f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:03.137837 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:03.249460 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb284206-eac8-4d7d-9ee9-c6ece66a9f8f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:03.291993 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:03.292779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:03.293093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:03.293445 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] PATH_INFO: `/v3/domains/af367482e6534eddb2c80c32a0f2302c` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:03.294793 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=af367482e6534eddb2c80c32a0f2302c)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:03.296282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158ad4e-0b92-4442-aa2f-36bf61eb57d1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:03.297919 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 593/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 19:46:03 2022] GET /identity/v3/domains/af367482e6534eddb2c80c32a0f2302c => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:03.304049 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:03.407711 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:03.411095 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dffcf-d4d9-4228-9c01-9c67bf1cee10 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:03.449035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:03.449757 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:03.450044 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:03.450360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:03.451116 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:03.452627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fa960-1185-45d6-8d54-b854214b62bb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:03.473200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 584/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:46:03 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:46:05.694463 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caabeb-1f9d-49a0-8bf6-b4115e6da225 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:05.695344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caabeb-1f9d-49a0-8bf6-b4115e6da225 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:05.695487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08caabeb-1f9d-49a0-8bf6-b4115e6da225 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:05.697650 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 594/1178] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:05.704012 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:05.704455 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:05.704586 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:05.726315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:05.727582 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:05.800107 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 585/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:05.828614 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caabeb-1f9d-49a0-8bf6-b4115e6da225 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:05.909939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:05.953924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08caabeb-1f9d-49a0-8bf6-b4115e6da225 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:05.988903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:05.989690 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:05.989972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:05.990248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:06.001521 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:06.009235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:06.010392 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:46:06.011712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 595/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:06.017304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:06.108832 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:06.125762 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858846e9-5c35-4a6c-8dbf-1260c47d135f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:06.160377 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:06.160983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:06.161265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:06.161540 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:06.162292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:06.162601 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:06.164028 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:06.172252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 586/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:06.178755 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:06.288802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0042a-a0a7-40b9-b6d3-003d3d9de1e0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:06.317584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:06.324438 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:06.325306 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:06.325587 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:06.325904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] PATH_INFO: `/v3/users/7d7834d5acf449f08a27251f696562fc` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:06.338808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] RBAC: Authorizing `identity:get_user(user_id=7d7834d5acf449f08a27251f696562fc)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:06.340265 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:06.341923 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 596/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:46:06 2022] GET /identity/v3/users/7d7834d5acf449f08a27251f696562fc => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:06.350715 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:06.458507 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f505c07-cb18-46b2-813c-e21a93fca6e6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:06.494117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:06.494753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:06.495067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:06.495339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:06.515360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:06.574710 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:06.576184 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:06.695411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 587/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:46:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:06.705080 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:06.812498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29c956-91d1-4d34-a956-ecbbb5b662bb None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:06.847634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:06.848487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:06.848771 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:06.849048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] PATH_INFO: `/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:06.850347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] RBAC: Authorizing `identity:get_project(project_id=4cf7c26263ec4434a5c6e4f7df65e537)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:06.851820 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b7b3-bf43-43f9-9e7c-147f7f2c2889 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:06.853505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 597/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:46:06 2022] GET /identity/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:06.861338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:06.915578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:06.972653 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b63ffc-f7cb-4172-a521-c92bd39c5e7c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:07.011281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:07.011936 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:07.012220 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:07.012501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:07.013411 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=4cf7c26263ec4434a5c6e4f7df65e537, user.id=7d7834d5acf449f08a27251f696562fc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:07.013718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:07.015200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1856-8f6f-48c3-84f9-d597553f3ee1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:07.020676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 588/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:46:06 2022] GET /identity/v3/role_assignments?user.id=7d7834d5acf449f08a27251f696562fc&scope.project.id=4cf7c26263ec4434a5c6e4f7df65e537&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:09.195387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14e97-eabc-4d66-99d6-f866cb8a320c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.196278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14e97-eabc-4d66-99d6-f866cb8a320c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.196278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14e97-eabc-4d66-99d6-f866cb8a320c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.198509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 598/1186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:09.206843 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.207281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.207393 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.225919 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:09.227214 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:09.307281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 589/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:46:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:46:09.337072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14e97-eabc-4d66-99d6-f866cb8a320c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:09.406643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:09.455104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14e97-eabc-4d66-99d6-f866cb8a320c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:09.491323 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:09.492109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.492395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.492672 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.503507 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:09.511182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:09.512277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:46:09.513147 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 599/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:09.518881 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:09.562239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:09.624886 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a793c1-7c3c-4e70-904b-527a892dcfde None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:09.662629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:09.663340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.663627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.663904 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.664661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:09.664970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:09.666359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:09.674880 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 590/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:46:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:09.681083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:09.791213 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef135-8f3e-4bf8-98c1-cf8faae9b5c2 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:09.807122 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:09.828757 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:09.829626 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.829906 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.830180 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] PATH_INFO: `/v3/users/7d7834d5acf449f08a27251f696562fc` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.831436 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] RBAC: Authorizing `identity:get_user(user_id=7d7834d5acf449f08a27251f696562fc)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:09.832890 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:09.834508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 600/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:46:09 2022] GET /identity/v3/users/7d7834d5acf449f08a27251f696562fc => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:09.840325 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:09.950822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cafad-1632-4408-9584-a28ab33c8bcb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:09.953162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:09.992022 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:09.992899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:09.993187 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:09.993464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] PATH_INFO: `/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:09.994731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4cf7c26263ec4434a5c6e4f7df65e537)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:09.996221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8452f-74a7-4bba-bf7b-bd4dbdb920e5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:09.997940 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 591/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:46:09 2022] GET /identity/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:10.006533 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:10.109139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fd2d-9ab6-41ac-92d3-d04cfbea3c7a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:10.144688 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:10.145558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:10.145839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:10.146108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] PATH_INFO: `/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537/users/7d7834d5acf449f08a27251f696562fc/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:10.148329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] RBAC: Authorizing `identity:create_grant(project_id=4cf7c26263ec4434a5c6e4f7df65e537, user_id=7d7834d5acf449f08a27251f696562fc, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:10.149745 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d5cf2-7f16-48d3-8d98-daf0f9e2bf3c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:10.164711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 601/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:46:10 2022] PUT /identity/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537/users/7d7834d5acf449f08a27251f696562fc/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:46:12.323735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46c9a-c57a-411a-80bf-0cde5264485a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:12.324292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46c9a-c57a-411a-80bf-0cde5264485a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:12.324292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a46c9a-c57a-411a-80bf-0cde5264485a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:12.325770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 592/1193] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:46:12.332224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:12.332929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:12.333073 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:12.359423 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:46:12.360623 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:46:12.402583 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:12.436938 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 602/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:46:12.460705 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a46c9a-c57a-411a-80bf-0cde5264485a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:12.572119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a46c9a-c57a-411a-80bf-0cde5264485a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:12.607625 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:12.608341 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:12.608634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:12.608902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:12.620379 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:46:12.628038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:46:12.629203 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:46:12.630119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 593/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:46:12.635501 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:12.736349 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503c718-c29d-41f9-9ab4-b27c583a2f02 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:12.770655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:12.771344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:12.771602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:12.771878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:12.772647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:12.772950 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:12.774313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:12.782513 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 603/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:12.791915 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:12.827045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:12.903447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2604fbe-f1d4-40a3-99e7-65c970b59768 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:12.951627 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:12.952497 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:12.952793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:12.953069 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] PATH_INFO: `/v3/users/7d7834d5acf449f08a27251f696562fc` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:12.954316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] RBAC: Authorizing `identity:get_user(user_id=7d7834d5acf449f08a27251f696562fc)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:12.955800 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:12.957413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 594/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:46:12 2022] GET /identity/v3/users/7d7834d5acf449f08a27251f696562fc => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:46:12.963379 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:13.014483 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:13.084280 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce35a5-0ecb-470b-85c2-b373e9a7b0b4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:13.124666 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:13.125317 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:13.125604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:13.125882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:13.199282 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:13.200682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:13.238932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:13.305986 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 604/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:46:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:46:13.313659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:13.420258 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:13.423654 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7973ea-104b-4160-9137-2b19a111f309 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:13.459134 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:13.459925 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:13.460225 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:13.460581 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] PATH_INFO: `/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:13.461792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] RBAC: Authorizing `identity:get_project(project_id=4cf7c26263ec4434a5c6e4f7df65e537)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:13.463272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6a39a-9401-42ec-89c3-d01f23ac44c4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:13.464934 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 595/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:46:13 2022] GET /identity/v3/projects/4cf7c26263ec4434a5c6e4f7df65e537 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:13.471861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:46:13.583834 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7224-fb69-48e4-b8dc-35ce50445e9a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:46:13.619121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:46:13.619774 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:46:13.620062 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:46:13.620336 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:46:13.621175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=4cf7c26263ec4434a5c6e4f7df65e537, user.id=7d7834d5acf449f08a27251f696562fc) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:46:13.621487 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:46:13.622996 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27195be5-249c-4751-80dd-07e7818e2e19 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:46:13.625848 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:46:13.629804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 605/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:46:13 2022] GET /identity/v3/role_assignments?user.id=7d7834d5acf449f08a27251f696562fc&scope.project.id=4cf7c26263ec4434a5c6e4f7df65e537&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:46:23.454468 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=16 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:14.439037 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe58-fe5d-4a31-90ef-db79ab7a3d55 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:14.439757 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe58-fe5d-4a31-90ef-db79ab7a3d55 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:14.439757 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fe58-fe5d-4a31-90ef-db79ab7a3d55 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:14.440970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 596/1201] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:14.447025 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:14.447492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:14.447582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:14.467237 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:14.468670 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:14.546131 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 606/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:14.571609 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fe58-fe5d-4a31-90ef-db79ab7a3d55 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:14.693997 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3fe58-fe5d-4a31-90ef-db79ab7a3d55 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:14.732452 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:14.733261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:14.733550 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:14.733833 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:14.744274 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:14.745891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:14.765062 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:14.766160 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:14.767181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:14.767181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:14.767181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:14.767181 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:14.767927 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 597/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:14.773113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:14.876418 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae69c3c-9017-4882-bb60-c606416e3746 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:14.917194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:14.924612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:14.925361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:14.925781 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:14.926101 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:14.927139 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:14.927505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:14.929070 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31df7a4-1b3c-4791-99fb-eb3bb0ceb6f3 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:14.946669 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 607/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:14.948112 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:15.011259 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:15.062882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f9fd2-ebf5-4c31-8cb2-1a2eb681bda4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:15.101897 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:15.103031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:15.103294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:15.103900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:15.104729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:15.106245 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444f680-a20d-4e70-b1d9-73eb5fe6e10d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:15.129795 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 598/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:47:14 2022] POST /identity/v3/users => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:47:17.480535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ff8f-c30a-4708-bd67-33382fc8bae3 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:17.481160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ff8f-c30a-4708-bd67-33382fc8bae3 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:17.481160 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20ff8f-c30a-4708-bd67-33382fc8bae3 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:17.482746 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 608/1206] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:17.488426 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:17.488882 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:17.488974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:17.506561 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:17.507845 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:17.585653 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 599/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:17.609255 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ff8f-c30a-4708-bd67-33382fc8bae3 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:17.728126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20ff8f-c30a-4708-bd67-33382fc8bae3 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:17.766752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:17.767540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:17.767824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:17.768115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:17.783371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:17.792049 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:17.793249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:17.794141 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 609/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:17.799591 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:17.852018 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:17.930213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bea1f-429d-4fea-a43d-20fad6d95ea9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:17.968479 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:17.969213 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:17.969505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:17.969834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:17.970605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:17.970993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:17.972572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:17.982512 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 600/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:17.988461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:18.044573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:18.100571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541d803-e8f9-4e60-8e8d-6445cce71414 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:18.140553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:18.141375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:18.141665 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:18.141945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:18.153454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:18.155048 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:18.177089 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:18.178138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:18.179627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:18.179627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:18.179627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:18.179627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:18.179627 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 610/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:18.184709 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:18.299822 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:18.304146 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974766ef-b4ea-4085-9e8a-4787f0954dca None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:18.343306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:18.344100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:18.344505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:18.344823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:18.345708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:18.346127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:18.347751 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:18.367596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:18.368130 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 601/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:18.476488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96ed96-0817-468d-83c0-67ed9db04fec None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:18.478647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:18.514002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:18.514851 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:18.515140 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:18.515417 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:18.522796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:18.524308 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:18.540286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:18.541329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:18.542348 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:18.546390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 611/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:18.547464 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:18.664788 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a11c-5280-470d-b44e-5f194722dd85 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:18.702418 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:18.703113 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:18.703395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:18.703678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:18.704505 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:18.704813 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:18.706508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:18.728985 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 602/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:18.730899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:18.843357 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde5d64-9b69-4d0f-a50f-25aa6c015e48 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:18.883060 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:18.883968 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:18.884290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:18.884598 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:18.921014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:18.959729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:18.961342 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:19.073246 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 612/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:47:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:47:19.079467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:19.101151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:19.200472 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d596c-4641-4c76-b0da-ff9fec392db0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:19.240879 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:19.241676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:19.242004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:19.242323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:19.255632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:19.257200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:19.276200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:19.277522 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:19.278450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:19.278450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:19.278450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:19.278450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:19.283682 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:19.285841 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 603/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:19.352201 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:19.402813 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697afc6-dcf8-4ddc-ad0d-c06da303245e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:19.445649 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:19.447003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:19.447003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:19.447198 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:19.447885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:19.448240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:19.449730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:19.462388 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 613/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:19.468256 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:19.557409 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:19.595693 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09138b-bd49-49ff-9a15-77a50751bde5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:19.633910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:19.634838 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:19.635143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:19.635500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:19.643344 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:19.644962 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:19.664814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:19.665846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:19.672011 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 604/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:19.672590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:19.795425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad5692-f2be-4e06-80d6-19818060b3b0 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:19.823597 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:19.832677 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:19.833824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:19.833824 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:19.834031 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:19.834917 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:19.835238 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:19.836818 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bb3d9-30ab-4905-bb77-16ae7b5b01c1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:19.850058 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 614/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:19.857089 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:19.969582 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbde66-3f4e-4247-b3fb-b491c01f1153 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:20.000413 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:20.008514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:20.009888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:20.009888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:20.009888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:20.010726 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d0dc66acf6574140b71b6f57cb838652) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:20.011084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:20.012578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36565927-cd04-457f-89aa-0937a6af13bf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:20.026964 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 605/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:47:19 2022] GET /identity/v3/role_assignments?user.id=d0dc66acf6574140b71b6f57cb838652&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:22.243878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce066-d90c-4c57-ba01-68405fc08b40 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:22.244452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce066-d90c-4c57-ba01-68405fc08b40 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:22.244452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ce066-d90c-4c57-ba01-68405fc08b40 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:22.246164 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 615/1220] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:22.251718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:22.252182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:22.252302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:22.272260 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:22.273502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:22.344500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 606/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:22.367286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce066-d90c-4c57-ba01-68405fc08b40 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:22.480414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ce066-d90c-4c57-ba01-68405fc08b40 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:22.519063 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:22.519811 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:22.520097 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:22.520378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:22.531289 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:22.540425 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:22.541726 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:22.542928 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 616/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:47:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:22.548166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:22.655294 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f282f5c-d385-4568-b340-c4e0117df85f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:22.682516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:22.696280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:22.697067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:22.697380 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:22.697768 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:22.698792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:22.699162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:22.700970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:22.709410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 607/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:22.715494 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:22.760056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:22.817796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea6c2c-1013-4ddb-9768-beb65bcd68e9 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:22.852784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:22.853900 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:22.854242 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:22.854504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:22.865974 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:22.867634 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:22.887578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:22.889136 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:22.890259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:22.890259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:22.890259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:22.890259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:22.890259 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 617/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:22.895088 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.006217 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3385d-e455-49b2-ab55-91079f3cb81b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.044147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.044850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.045143 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.045457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.046221 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:23.046567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.048607 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.062038 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 608/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:23.067963 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.180507 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:23.193708 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420201c-5176-4b95-8ee7-5119f93aeb2e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.230651 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.231580 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.231862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.232148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.240679 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.242230 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:23.258011 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:23.259722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:23.260959 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 618/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:23.265974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.316086 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:23.374539 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51892d20-8b5d-4862-8ad9-7b33d7804f0b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.412559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.413353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.413665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.413947 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.414885 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:23.415246 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.416899 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.435163 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 609/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:23.442714 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.549214 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a031e-8ac8-4a7c-89ed-3fbe61447c8a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.585697 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.586509 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.586937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.587100 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.597905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.599405 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:23.617875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:23.619109 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:23.620452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:23.620452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:23.620452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:23.620452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:23.620452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 619/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:47:23.625676 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.739799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65779-cd15-4e37-967c-b0f2b3e7eb4f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.742378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:23.776778 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.777443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.779270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.779570 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.780383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:23.780902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.782328 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.794311 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 610/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:23.800192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:23.810361 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:23.908914 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbf8aa-d2fe-4726-820d-e064e49ce668 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:23.942552 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:23.943474 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:23.943765 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:23.944086 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:23.951087 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:23.952707 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:23.968791 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:23.969946 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:23.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:23.976288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 620/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:23.976424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:24.085806 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3db8-0931-4f21-b774-3584648f82ee None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:24.123974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:24.124735 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:24.125034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:24.125312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:24.126173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:24.126669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:24.128165 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc9527-ca5e-4294-96f2-078ce18f6115 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:24.141678 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 611/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:24.148021 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:24.221878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:24.258930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b2ef5-097e-451f-a0d0-89d9eca3cc84 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:24.295287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:24.296288 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:24.296595 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:24.296878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d0dc66acf6574140b71b6f57cb838652/roles/4bddaa3589fd49a69eaef20de75fd8f8` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:24.312977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=d0dc66acf6574140b71b6f57cb838652, role_id=4bddaa3589fd49a69eaef20de75fd8f8)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:24.314451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66639f-a929-4382-958f-760fb8ba86a8 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:24.328500 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 621/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:47:24 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d0dc66acf6574140b71b6f57cb838652/roles/4bddaa3589fd49a69eaef20de75fd8f8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:47:26.790467 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d4b9-bd6f-4b96-a499-9e3f38db35e3 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:26.791264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d4b9-bd6f-4b96-a499-9e3f38db35e3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:26.791264 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9d4b9-bd6f-4b96-a499-9e3f38db35e3 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:26.792731 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 612/1233] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:26.799126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:26.799584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:26.799691 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:26.818575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:26.820164 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:26.892146 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 622/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:47:26.916046 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9d4b9-bd6f-4b96-a499-9e3f38db35e3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:26.943756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:27.030871 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9d4b9-bd6f-4b96-a499-9e3f38db35e3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.069819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.070784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.071073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.071347 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.082384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:27.092196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:27.093327 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:27.094185 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 613/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:47:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:27.099972 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:27.151052 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:27.216223 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85fd85-c351-4e65-9d9b-d1e573e45d56 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.251478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.252219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.252542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.252882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.253718 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:27.254024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:27.255454 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:27.263920 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 623/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:27.270405 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:27.369015 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:27.386335 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba390-ca4b-4a66-bb60-f811419f8e68 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.422239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.423053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.423339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.423598 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.434240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:27.435835 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:27.454865 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:27.461332 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:27.462485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:27.462485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:27.462485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:27.462485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:27.462485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 614/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:47:27.462882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:27.579215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae98a7-a22b-4eac-a8a5-ddfe4d0928e6 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.591571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:27.618217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.618934 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.619205 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.619584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.620311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:27.620744 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:27.622129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:27.633716 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 624/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:27.640777 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:27.751576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27657-c265-4f7c-91d2-0a26ee138333 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.789503 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.790321 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.790603 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.791205 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.794383 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:27.799617 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:27.801147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:27.815932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:27.817164 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:27.824285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 615/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:27.824905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:27.931894 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3393b-9f04-4817-9a52-a46c27ae58e4 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:27.970075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:27.970787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:27.971075 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:27.971355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:27.972200 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:27.972553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:27.974129 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:27.993406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 625/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:27.999698 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:28.114721 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4734b3-34b9-45a1-b177-8005215d7acd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:28.156616 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:28.157278 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:28.157566 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:28.157834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:28.220734 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:28.229888 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:28.231554 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:28.344983 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 616/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:47:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:47:28.351036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:28.383864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:28.469805 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4a2af-d52b-4020-ae74-72978c66d28a None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:28.515012 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:28.515961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:28.516290 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:28.516613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:28.528481 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:28.530085 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:28.551220 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:28.552646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:28.553843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:28.553843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:28.553843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:28.553843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:28.553843 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 626/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:28.558820 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:28.676458 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:28.684285 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7eed-4d6c-4da0-b806-47e7a72ef229 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:28.724825 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:28.725500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:28.725799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:28.726074 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:28.726900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:28.727172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:28.728960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:28.742410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 617/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:28.748550 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:28.833287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:28.857505 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a71853-1015-4d36-89ae-551d68fe6a09 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:28.894064 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:28.894905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:28.895192 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:28.895516 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:28.904656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:28.904656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:28.918232 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:28.919437 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:28.920414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 627/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:28.925557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:29.040030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466afdb-7578-481c-8158-cf0bfaf70050 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:29.079051 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:29.079770 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:29.080079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:29.080384 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:29.081247 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:29.081597 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:29.083197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d7e4-d85b-408e-98c5-2212b49becde None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:29.102267 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 618/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:29.104039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:29.210032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6182f1-b361-4e2a-b80e-56ce2acca6c1 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:29.244892 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:29.245548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:29.245832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:29.246107 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:29.246984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] RBAC: Adding query filter params (role.id=4bddaa3589fd49a69eaef20de75fd8f8, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d0dc66acf6574140b71b6f57cb838652) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:29.247303 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:29.248742 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1a271-9581-4511-8694-1844e5558633 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:29.254870 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 628/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:47:29 2022] GET /identity/v3/role_assignments?user.id=d0dc66acf6574140b71b6f57cb838652&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=4bddaa3589fd49a69eaef20de75fd8f8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:31.505215 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f2cc-9a46-4333-b2c5-26f5fa6d81c0 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:31.506059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f2cc-9a46-4333-b2c5-26f5fa6d81c0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:31.506059 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5f2cc-9a46-4333-b2c5-26f5fa6d81c0 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:31.507182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 619/1247] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:47:31.512795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366372c-2653-40e8-9205-0f11e909453f None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:31.513272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366372c-2653-40e8-9205-0f11e909453f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:31.513272 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366372c-2653-40e8-9205-0f11e909453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:31.520854 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:31.540205 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-9366372c-2653-40e8-9205-0f11e909453f None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:31.541940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-9366372c-2653-40e8-9205-0f11e909453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:31.627353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 629/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:47:31.652874 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5f2cc-9a46-4333-b2c5-26f5fa6d81c0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:31.672334 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:31.762859 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5f2cc-9a46-4333-b2c5-26f5fa6d81c0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:31.798138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:31.798989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:31.799251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:31.799545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:31.810396 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:31.819144 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:31.820329 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:31.821304 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 620/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:31.826749 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366372c-2653-40e8-9205-0f11e909453f None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:31.934178 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366372c-2653-40e8-9205-0f11e909453f None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:31.965022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:31.970554 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:31.971452 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:31.971738 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:31.972018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:31.972779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:31.973088 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:31.974466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:31.983411 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 630/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:31.989381 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:32.074337 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:32.098373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238ff0-67ba-456b-a4a9-f6f0f78240a9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:32.136117 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:32.137043 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:32.137339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:32.137619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:32.150862 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:32.152360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:32.171649 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:32.172742 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:32.173644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:32.173644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:32.173644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:32.173644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:32.173644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 621/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:32.179221 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:32.293508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312fa26-5b7d-4157-9b16-6b75901c5317 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:32.332646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:32.333240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:32.333553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:32.333804 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:32.334508 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:32.334849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:32.336231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:32.348521 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 631/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:32.356196 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:32.477497 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3397ac-3477-4f43-8081-a85e4ca7ac95 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:32.512784 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:32.522589 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:32.523463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:32.523752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:32.524029 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:32.533073 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:32.534595 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:32.550852 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:32.552118 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:32.553407 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 622/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:47:32.558067 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:32.617151 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:32.669341 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5131f49-9259-47e0-aaf2-7f11df81e2cb None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:32.706871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:32.707561 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:32.707849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:32.708158 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:32.709014 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:32.709325 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:32.710802 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:32.730313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 632/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:32.736228 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:32.846805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b51d-482f-471e-9e9e-4ceae5a81bb4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:32.880739 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:32.881403 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:32.881685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:32.881956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:32.937976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:32.950670 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:32.952173 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.051499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 623/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:47:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:47:33.057517 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:33.156360 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd3d9-bbc8-46fa-83b1-4d1d660c31ae None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:33.169294 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:33.191661 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:33.192449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:33.192729 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:33.192998 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:33.203278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:33.204706 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:33.222531 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:33.223585 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:33.224624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:33.224624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:33.224624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:33.224624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:33.224624 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 633/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:33.230451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:33.332123 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:33.345693 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10727e-47a9-4807-9578-3d3616e24fbd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:33.382473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:33.383166 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:33.383448 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:33.383725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:33.384450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:33.384754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:33.386312 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.397553 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 624/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:33.404344 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:33.524945 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713723d4-da60-4799-93fa-b73c1ebf9914 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:33.562630 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:33.563468 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:33.563756 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:33.564031 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:33.571354 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:33.572833 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:33.587135 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:33.588211 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:33.589153 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 634/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:47:33.594345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:33.698199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052b959-2783-46a0-ba1d-f4d5a7a6f0f1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:33.738675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:33.739373 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:33.739766 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:33.740045 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:33.740844 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:33.741152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:33.742608 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893adc26-f72d-4be5-9b81-a2b078ad9505 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.755517 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 625/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:33.761828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:33.788365 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:33.883967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8742d-a96e-436c-abc2-1398bc22372e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:33.922828 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:33.923496 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:33.923775 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:33.924047 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:33.924879 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d0dc66acf6574140b71b6f57cb838652) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:33.925193 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:33.926673 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c203f03-59a1-4dda-8cfd-82d4e8abdab7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:33.932510 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 635/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:47:33 2022] GET /identity/v3/role_assignments?user.id=d0dc66acf6574140b71b6f57cb838652&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:36.088952 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb4d2-f662-4b8e-85ed-b9e2acdd8a40 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.089471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb4d2-f662-4b8e-85ed-b9e2acdd8a40 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.089471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb4d2-f662-4b8e-85ed-b9e2acdd8a40 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.091559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 626/1261] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:36.099434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.099899 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.100002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.118913 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:36.120124 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:36.195276 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 636/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:47:36.218639 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb4d2-f662-4b8e-85ed-b9e2acdd8a40 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:36.230752 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:36.337151 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb4d2-f662-4b8e-85ed-b9e2acdd8a40 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:36.378974 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:36.379701 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.379991 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.380265 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.391463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:36.399041 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:36.400207 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:36.401465 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 627/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:36.406461 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:36.427329 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:36.512447 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedd02d-da27-4163-ba01-54a8af3eff8e None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:36.556224 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:36.556990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.557279 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.557538 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.558286 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:36.558613 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:36.560002 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:36.568353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 637/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:47:36.575857 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:36.655126 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:36.692571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdf74b-96b3-42ac-a038-e1fad2cb9609 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:36.730182 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:36.731017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.731302 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.731578 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.743322 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:36.744870 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:36.762230 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:36.763326 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:36.764525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:36.764525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:36.764525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:36.764525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:36.764525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 628/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:36.769451 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:36.854347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:36.878056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7134f-2699-4f13-802e-9bc4c5cf7cfe None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:36.914459 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:36.915140 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:36.915427 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:36.915705 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:36.916478 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:36.916787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:36.918171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:36.930689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 638/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:36.937524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.049928 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2697-8813-45d9-90b1-a0cfce749097 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:37.069559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:37.085281 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:37.086067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:37.086349 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:37.086631 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:37.094410 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:37.095886 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:37.110596 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:37.111685 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:37.113017 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 629/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:37.119583 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.223618 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677444-f240-4606-8779-38227e3fc88d None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:37.265121 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:37.265796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:37.266083 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:37.266363 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] PATH_INFO: `/v3/users` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:37.267244 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:37.267557 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:37.268977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:37.279150 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:37.288792 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 639/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:37.298248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.409630 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a85cc2-28cf-4a43-b68f-5aafccca579a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:37.449252 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:37.450440 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:37.451003 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:37.451340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:37.465154 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:37.466669 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:37.488708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:37.489648 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:37.490559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:37.490559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:37.490559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:37.490559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:37.490559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 630/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:37.496548 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.613434 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71e050-285f-4d12-8faf-a85573bcd71c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:37.656930 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:37.658188 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:37.658327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:37.658768 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:37.659758 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:37.660283 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:37.662542 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:37.676650 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 640/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:37.683689 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.731157 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:37.808438 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628bb90-8d72-4fa2-8562-ecc3f4d732c2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:37.843449 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:37.844239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:37.844520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:37.844792 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:37.851745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:37.853604 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:37.867748 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:37.868863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:37.870079 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:37.870849 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 631/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:37.874736 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:37.933664 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:37.989045 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc37a1-0ccc-40fc-bf16-72f575733696 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:38.023922 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:38.024575 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:38.024864 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:38.025138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:38.025973 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:38.026315 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:38.027807 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b8381-45e1-44e8-9bdd-5ad0112d608f None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:38.039730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 641/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:38.048623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:38.142805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:38.157860 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4e73f-6963-43e8-b6f6-a8b71fb78381 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:38.202008 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:38.202930 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:38.203219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:38.203499 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] PATH_INFO: `/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d0dc66acf6574140b71b6f57cb838652/roles/1a189ac8308b420aa77decb136a045a2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:38.205469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff18dab8a2a45ae9d807718a7c7b995, user_id=d0dc66acf6574140b71b6f57cb838652, role_id=1a189ac8308b420aa77decb136a045a2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:38.206943 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e700f-72c4-43dd-9918-9d56de7978a8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:38.223463 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 632/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:47:38 2022] PUT /identity/v3/projects/fff18dab8a2a45ae9d807718a7c7b995/users/d0dc66acf6574140b71b6f57cb838652/roles/1a189ac8308b420aa77decb136a045a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:47:40.397327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eab07-f4ab-4a8a-9e4b-66a7ff22efd8 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:40.398170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eab07-f4ab-4a8a-9e4b-66a7ff22efd8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:40.398170 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eab07-f4ab-4a8a-9e4b-66a7ff22efd8 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:40.400567 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 642/1274] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:40.406814 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:40.407469 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:40.407723 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:40.433963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:40.435192 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:40.513102 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 633/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:40.536574 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eab07-f4ab-4a8a-9e4b-66a7ff22efd8 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:40.657378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eab07-f4ab-4a8a-9e4b-66a7ff22efd8 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:40.676114 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:40.696017 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:40.696822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:40.697206 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:40.697492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:40.707701 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:47:40.715362 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:40.716858 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:40.718210 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 643/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:40.722798 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:40.810248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:40.830840 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96362fc-f14f-4ffd-9313-a9342be1e332 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:40.865853 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:40.866509 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:40.866819 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:40.867092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:40.867837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:40.868147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:40.869558 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:40.878508 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 634/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:40.885202 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:40.995482 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0b681-9409-4308-b53f-f1920ecd5d7c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:41.035042 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:41.036194 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:41.036594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:41.036961 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:41.054904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:41.057036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:41.074353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:41.075375 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:41.076401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:41.076401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:41.076401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:41.076401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:41.076401 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 644/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:41.083996 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:41.192223 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdfbf1-9fab-4b7d-b5e0-dc39c69155a2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:41.225255 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:41.225910 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:41.226197 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:41.226479 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:41.227239 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:41.227551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:41.229289 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:41.240965 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 635/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:41.250116 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:41.294005 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:41.372599 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0874dc-fdbc-4c6d-9e38-2d76031e3eda None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:41.407311 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:41.408108 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:41.408390 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:41.408668 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:41.416790 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:41.418251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:47:41.432684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:41.433796 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:41.434939 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 645/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:41.440162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:41.444675 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:41.550661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b60f-45c6-4f09-b20e-849910e7e1c3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:41.584560 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:41.585229 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:41.585516 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:41.585793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:41.586633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:41.586976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:41.588425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:41.605759 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 636/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 19:47:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:41.611582 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:41.711488 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:41.722307 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7aca65-20ba-4ef0-a4df-d0ee24007b3e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:41.761980 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:41.762628 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:41.762941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:41.763217 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:41.832903 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:41.834285 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:41.929072 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:41.942535 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 646/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:47:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:47:41.948664 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:42.024119 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:42.063646 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886cd7-5e11-4d92-833e-dd1390d5f98e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:42.099248 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:42.099970 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:42.100257 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:42.100533 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:42.111336 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:42.112797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:47:42.130106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:42.131147 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:42.132064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:47:42.132064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:47:42.132064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:47:42.132064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:42.132064 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 637/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:42.137862 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:42.239905 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f6ec8-9fa5-4b45-95c0-4b2c9d972c27 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:42.275163 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:42.275822 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:42.276168 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:42.276353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] PATH_INFO: `/v3/domains` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:42.277095 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:42.277408 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:42.278803 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:42.289967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 647/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:42.296645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:42.415930 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eea6e9-20f7-47dc-9c89-6ff2758631ef None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:42.435963 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:42.457867 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:42.458708 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:42.459004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:42.459291 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:42.466100 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:42.467610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:47:42.481525 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:42.482557 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application May 19 19:47:42.483564 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 638/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:42.488797 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:42.550191 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:42.604167 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a12473-54f9-4fea-b787-5363976ac86c None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:42.638849 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:42.639498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:42.639788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:42.640053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] PATH_INFO: `/v3/projects` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:42.640839 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:42.641149 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:42.642577 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad545-f1b1-40ff-be0b-300219ec5afe None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:42.654732 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 648/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:42.660791 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:42.767530 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a004-ee7d-4958-9ea1-9d01dd2a7122 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:42.814576 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:42.816132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:42.816858 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:42.817568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:42.819740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] RBAC: Adding query filter params (role.id=1a189ac8308b420aa77decb136a045a2, scope.project.id=fff18dab8a2a45ae9d807718a7c7b995, user.id=d0dc66acf6574140b71b6f57cb838652) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:42.820548 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:42.822820 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260195c5-4337-49ac-8612-698f0889c2f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:42.829356 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 639/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:47:42 2022] GET /identity/v3/role_assignments?user.id=d0dc66acf6574140b71b6f57cb838652&scope.project.id=fff18dab8a2a45ae9d807718a7c7b995&role.id=1a189ac8308b420aa77decb136a045a2 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:45.039091 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2a6-98f3-4e90-8412-af25fec90cfb None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:45.039932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2a6-98f3-4e90-8412-af25fec90cfb None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:45.039932 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c2a6-98f3-4e90-8412-af25fec90cfb None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:45.041687 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 649/1288] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:45.048033 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:45.048756 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:45.048914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:45.075619 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:45.076797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:45.111127 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:45.151579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 640/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:45.174632 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c2a6-98f3-4e90-8412-af25fec90cfb None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:45.288084 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c2a6-98f3-4e90-8412-af25fec90cfb None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:45.300203 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:45.332861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:45.333655 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:45.333942 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:45.334219 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:45.334910 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:45.336297 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:45.348589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:45.349785 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:45.350643 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 650/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:47:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:45.356402 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:45.469718 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5985a0-ab89-4db1-b6aa-c946b04a6569 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:45.508219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:45.508896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:45.509199 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:45.509473 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:45.510372 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:45.510567 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:45.511998 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75183fe-9a61-4a61-a11c-f34c09770749 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:45.516950 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 641/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 19:47:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:45.523543 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:45.630984 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7909b0-d459-4535-9778-e0d2e1eb29f7 None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:45.670126 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:45.670831 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:45.671115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:45.671387 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] PATH_INFO: `/v3/services` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:45.672090 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:45.672395 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:45.673754 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3defe-cffe-44b2-8038-2f5330494d26 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:45.678571 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 651/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 19:47:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:47.846366 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eca3b-bc20-42f1-8801-75f416883c58 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:47.847266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eca3b-bc20-42f1-8801-75f416883c58 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:47.847266 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eca3b-bc20-42f1-8801-75f416883c58 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:47.849431 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 642/1293] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:47.858415 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8413a0-9ffc-41cd-b3b9-9f6851c5b8bb None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:47.858882 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8413a0-9ffc-41cd-b3b9-9f6851c5b8bb None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:47.859079 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8413a0-9ffc-41cd-b3b9-9f6851c5b8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:47.880040 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-ac8413a0-9ffc-41cd-b3b9-9f6851c5b8bb None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:47.881240 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ac8413a0-9ffc-41cd-b3b9-9f6851c5b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:47.911061 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:47.957337 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 652/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:47.983753 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eca3b-bc20-42f1-8801-75f416883c58 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:48.031659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:48.106272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eca3b-bc20-42f1-8801-75f416883c58 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:48.148330 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:48.149004 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:48.149292 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:48.149568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:48.150314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:48.151747 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0680bd4-f612-461b-9ce7-c3ad9059a6bb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:48.168345 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 643/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:47:47 2022] POST /identity/v3/services => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:47:50.377404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fea63-4f33-40bd-b459-4604aa926ae2 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:50.377992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fea63-4f33-40bd-b459-4604aa926ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:50.377992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fea63-4f33-40bd-b459-4604aa926ae2 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:50.379449 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 653/1296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:50.385818 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:50.386559 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:50.386737 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:50.415514 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:50.416780 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:50.513447 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 644/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:50.536106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fea63-4f33-40bd-b459-4604aa926ae2 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:50.639179 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fea63-4f33-40bd-b459-4604aa926ae2 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:50.677018 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:50.677831 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:50.678117 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:50.678396 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:50.679091 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:50.680502 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:50.692981 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:50.694148 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:50.695171 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 654/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:47:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:50.700929 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:50.724992 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:50.816793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa53c-1b0f-484a-be24-76939cecaaf9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:50.852262 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:50.853270 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:50.853572 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:50.853932 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:50.854640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:50.854987 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:50.856357 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:50.861560 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 645/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 19:47:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:50.870492 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:50.902795 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:50.978475 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84ceb-4cf1-4adc-b048-75e0427c45cf None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:51.015043 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:51.015689 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:51.015977 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:51.016256 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:51.017053 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] RBAC: Adding query filter params (interface=public, service_id=3e34abcc75044b7f894d072db8e21c8b, region_id=RegionOne) {{(pid=80283) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:51.017370 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:51.018733 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219cbd-928d-4132-ad1a-949fa12cdf64 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:51.023987 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 655/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:47:50 2022] GET /identity/v3/endpoints?service_id=3e34abcc75044b7f894d072db8e21c8b&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:51.033053 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:51.124856 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:51.148279 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8039-4c34-41b7-bfa2-25c496438083 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:51.185085 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:51.185684 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:51.185968 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:51.186251 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:51.186972 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:51.188359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165f316-af1a-4304-884f-8d3dfb363d92 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:51.195378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 646/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:47:51 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:47:53.385017 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5f7a-6bda-47be-8796-a9950297f96a None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:53.385578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5f7a-6bda-47be-8796-a9950297f96a None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:53.385578 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab5f7a-6bda-47be-8796-a9950297f96a None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:53.387094 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 656/1302] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:47:53.393423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:53.394152 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:53.394277 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:53.420092 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:47:53.421323 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:47:53.491195 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 647/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:47:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:47:53.514532 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab5f7a-6bda-47be-8796-a9950297f96a None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:53.613545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:53.621846 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab5f7a-6bda-47be-8796-a9950297f96a None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:53.657457 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:53.658263 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:53.658558 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:53.658863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:53.659525 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:53.660902 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:47:53.672830 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:47:53.673990 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application with Lock( May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self._enter() May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application return self.creator() May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application created_value = creator( May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: ERROR keystone.server.flask.application May 19 19:47:53.675248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 657/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:47:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:47:53.680133 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:53.757314 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:47:53.782475 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ed9a-a69f-4a13-96e7-5d2b53767dc5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:53.823492 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:53.824492 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:53.824946 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:53.825385 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:53.826471 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:47:53.826993 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:53.829244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ec8f-a5db-426f-a89c-0f868ee14951 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:53.837699 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 648/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 19:47:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:47:53.843684 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:47:53.957118 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3bdec-4c25-4afc-b561-6f6c72d1888e None admin] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:47:54.000878 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d45c6601e340739e7025d543a6a1d4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:47:54.001524 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:47:54.001814 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:47:54.002093 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:47:54.002875 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:47:54.004249 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d44f79-8a16-49b9-8be2-868517d5c230 None admin] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:47:54.024728 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 658/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:47:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:48:03.832295 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=30 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:48:04.020612 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:48:57.812424 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ef9e-2fc5-4ad7-a85b-2d5e451924d4 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:48:57.812863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ef9e-2fc5-4ad7-a85b-2d5e451924d4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:48:57.812863 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387ef9e-2fc5-4ad7-a85b-2d5e451924d4 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:48:57.814417 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 649/1307] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:48:57.823924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee24e-13db-437e-8855-c06ead813441 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:48:57.823924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee24e-13db-437e-8855-c06ead813441 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:48:57.823924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee24e-13db-437e-8855-c06ead813441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:48:57.917022 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-be1ee24e-13db-437e-8855-c06ead813441 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:48:57.919644 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-be1ee24e-13db-437e-8855-c06ead813441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:48:58.092523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 659/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:48:58.143642 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319772ca-0014-414b-9275-efefa9a010db None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:48:58.144122 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319772ca-0014-414b-9275-efefa9a010db None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:48:58.144414 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319772ca-0014-414b-9275-efefa9a010db None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:48:58.145805 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 650/1309] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 19:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:48:58.152656 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea339-5d87-44be-9413-93b5ae3ffa88 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:48:58.152907 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea339-5d87-44be-9413-93b5ae3ffa88 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:48:58.153161 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea339-5d87-44be-9413-93b5ae3ffa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:48:58.270769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-76bea339-5d87-44be-9413-93b5ae3ffa88 None None] MFA Rules not processed for user `cd09cd3eee934b22b8b3cad100e8f930`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:48:58.272871 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-76bea339-5d87-44be-9413-93b5ae3ffa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:48:58.310602 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:48:58.404523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 660/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 19:48:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:48:58.414002 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319772ca-0014-414b-9275-efefa9a010db None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:48:58.415914 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-319772ca-0014-414b-9275-efefa9a010db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:48:58.532960 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319772ca-0014-414b-9275-efefa9a010db None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:48:58.610350 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:48:58.611034 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:48:58.611315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:48:58.611589 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:48:58.613222 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:48:58.674644 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:48:58.732238 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:48:58.734084 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c405b0-8d02-427a-a69a-2ee5732dfdc0 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:48:58.754358 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 651/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:01.262589 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:01.263215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:01.263215 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:01.264702 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 661/1312] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:01.270583 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffba23-bdb3-4a9b-a1f5-a8804e2d2a4e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:01.271081 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffba23-bdb3-4a9b-a1f5-a8804e2d2a4e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:01.271176 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffba23-bdb3-4a9b-a1f5-a8804e2d2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:01.376019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-77ffba23-bdb3-4a9b-a1f5-a8804e2d2a4e None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:01.379502 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-77ffba23-bdb3-4a9b-a1f5-a8804e2d2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:01.502306 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 652/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:01.541402 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:01.543353 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:01.670106 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aac07-7dff-43fd-9bbe-195638840ce7 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:01.743393 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:01.746711 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:01.747394 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:01.747654 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:01.747906 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:01.750039 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:01.859782 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:01.861243 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e11694-29d4-4d6e-9c54-76a9b8e730fc service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:01.880381 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 662/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:04.436524 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:04.437404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:04.437404 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:04.439868 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 653/1315] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:04.446458 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1640c-30d4-4793-8415-ce99768b6b13 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:04.447278 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1640c-30d4-4793-8415-ce99768b6b13 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:04.447641 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1640c-30d4-4793-8415-ce99768b6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:04.518573 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-c7c1640c-30d4-4793-8415-ce99768b6b13 None None] MFA Rules not processed for user `f30057d164aa4fa2abc8c559f0cda5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:04.519826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-c7c1640c-30d4-4793-8415-ce99768b6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:04.577553 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:04.631430 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 663/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:04.673401 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:04.675959 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:04.691891 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:04.796035 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33176-39b5-49f2-81ba-58ea71ba8aad None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:04.886423 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:04.887109 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:04.887395 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:04.887680 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:04.889354 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:04.953665 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:05.008138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:05.009611 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207ac93-85d2-487f-b9a4-cfdefbac061a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:05.029571 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 654/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:07.781647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:07.782562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:07.782562 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:07.784770 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 664/1318] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:07.790340 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3bf5-6c6f-417c-8cec-a1aaa1949545 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:07.790797 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3bf5-6c6f-417c-8cec-a1aaa1949545 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:07.790902 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3bf5-6c6f-417c-8cec-a1aaa1949545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:07.858500 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-534b3bf5-6c6f-417c-8cec-a1aaa1949545 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:07.859953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-534b3bf5-6c6f-417c-8cec-a1aaa1949545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:07.960623 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 655/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:08.014530 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:08.016177 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:08.135032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1cd70-262b-44a7-ad55-47bb95a4ae0d None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:08.207776 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:08.208414 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:08.208695 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:08.208966 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:08.210784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:08.219208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:08.324498 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:08.325954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0dee0-8294-4438-9db2-b70c8b584f6c service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:08.343419 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 665/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:11.211725 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687c5a-9101-41c1-a9ff-36e9a1e356aa None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:11.212308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687c5a-9101-41c1-a9ff-36e9a1e356aa None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:11.212308 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687c5a-9101-41c1-a9ff-36e9a1e356aa None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:11.213632 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 656/1321] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:11.219472 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f0fc-44ad-4f0f-967d-383fdaf57ca8 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:11.219929 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f0fc-44ad-4f0f-967d-383fdaf57ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:11.220032 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f0fc-44ad-4f0f-967d-383fdaf57ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:11.284523 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-90c6f0fc-44ad-4f0f-967d-383fdaf57ca8 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:11.285722 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-90c6f0fc-44ad-4f0f-967d-383fdaf57ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:11.347705 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:11.390355 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 666/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:11.441153 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:11.441437 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:11.441714 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:11.443087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 657/1323] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 19:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:11.449885 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da386c9c-847d-4e1b-ba17-1015e76bd9b7 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:11.450231 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da386c9c-847d-4e1b-ba17-1015e76bd9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:11.450519 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da386c9c-847d-4e1b-ba17-1015e76bd9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:11.527740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-da386c9c-847d-4e1b-ba17-1015e76bd9b7 None None] MFA Rules not processed for user `cd09cd3eee934b22b8b3cad100e8f930`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:11.528886 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-da386c9c-847d-4e1b-ba17-1015e76bd9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:11.605518 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 667/1324] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:11.614480 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:11.616408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:11.636754 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:11.725527 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d881cd-ecf3-4364-906a-d8a22a20a877 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:11.803319 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:11.803909 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:11.804211 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:11.804481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:11.806138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:11.879990 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:11.919200 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:11.920674 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f76eb7-affb-4e34-a439-4ebd1bc0c3f2 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:11.939673 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 658/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:14.404386 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:14.404926 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:14.404926 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:14.406423 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 668/1326] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:14.411938 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f217-e972-4ade-8b5d-53315ebe082a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:14.412378 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f217-e972-4ade-8b5d-53315ebe082a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:14.412634 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f217-e972-4ade-8b5d-53315ebe082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:14.481758 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1a03f217-e972-4ade-8b5d-53315ebe082a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:14.483019 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1a03f217-e972-4ade-8b5d-53315ebe082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:14.583633 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 659/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:14.619404 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:14.620967 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:14.686856 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:14.735235 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b0c5-e97f-41ac-bc2b-fc2b54c5259b None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:14.808808 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:14.809476 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:14.809760 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:14.810036 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:14.811954 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:14.927800 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:14.930251 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:14.931809 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5b7fe-9a08-4dd5-b3fe-1016c72498a9 service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:14.949947 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 669/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:17.215662 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:17.216240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:17.216240 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:17.217615 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 660/1329] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:17.223208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ebbcc-2b2b-4d30-92af-e310144b61b3 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:17.223642 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ebbcc-2b2b-4d30-92af-e310144b61b3 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:17.223889 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ebbcc-2b2b-4d30-92af-e310144b61b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:17.297940 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-680ebbcc-2b2b-4d30-92af-e310144b61b3 None None] MFA Rules not processed for user `f30057d164aa4fa2abc8c559f0cda5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:17.299207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-680ebbcc-2b2b-4d30-92af-e310144b61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:17.395287 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 670/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:17.432148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:17.433837 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:17.466877 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:17.547732 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae69bf-0bda-45a4-8f8e-aa64219e8617 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:17.622628 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:17.623359 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:17.623629 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:17.623900 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:17.625552 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:17.707605 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:17.741958 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:17.743457 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7edf6f-c909-4f73-8654-f067dde4581b service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:17.762476 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 661/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:20.381112 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:20.381675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:20.381675 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:20.383181 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 671/1332] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:20.388916 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3d4a-1b99-44cc-9fe5-ccef5d28fb17 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:20.389445 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3d4a-1b99-44cc-9fe5-ccef5d28fb17 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:20.389555 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3d4a-1b99-44cc-9fe5-ccef5d28fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:20.467883 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-04de3d4a-1b99-44cc-9fe5-ccef5d28fb17 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:20.469162 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-04de3d4a-1b99-44cc-9fe5-ccef5d28fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:20.569217 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 662/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:20.605435 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:20.607103 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:20.681600 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:20.718312 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a063d0-fdf4-4df7-af0c-c31f4ef112a5 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:20.793324 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:20.793904 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:20.794182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:20.794456 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:20.796154 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:20.908309 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:20.909761 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cdd78-8081-4444-b660-c31544625075 service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:20.919873 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:20.928778 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 672/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:23.194730 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:23.195316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:23.195316 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:23.196682 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 663/1335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:23.203102 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598eff-908b-4e14-905e-f495207dd743 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:23.203779 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598eff-908b-4e14-905e-f495207dd743 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:23.204016 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598eff-908b-4e14-905e-f495207dd743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:23.276712 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-4b598eff-908b-4e14-905e-f495207dd743 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:23.277941 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-4b598eff-908b-4e14-905e-f495207dd743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:23.389606 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 673/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:23.430368 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:23.432729 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:23.478613 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:23.550799 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c7dd2-9964-4492-b512-62ad2edacb05 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:23.629826 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:23.630466 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:23.630793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:23.631060 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:23.632768 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:23.738793 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:23.767219 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:23.768690 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c900052-79c7-463a-90b0-bad0dd110be6 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:23.787076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 664/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:26.313861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:26.314391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:26.314391 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:26.316077 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 674/1338] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:26.322485 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f10-95df-42d1-b0f1-9951d3edebcd None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:26.322956 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f10-95df-42d1-b0f1-9951d3edebcd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:26.323076 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9f10-95df-42d1-b0f1-9951d3edebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:26.410501 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c49e9f10-95df-42d1-b0f1-9951d3edebcd None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:26.412125 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c49e9f10-95df-42d1-b0f1-9951d3edebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:26.514433 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 665/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:26.549740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:26.551310 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:26.648704 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:26.677826 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccc103-4203-4254-82c1-14fb6841103c None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:26.765050 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:26.765951 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:26.766347 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:26.766769 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:26.769410 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:26.887924 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:26.889364 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5984294-b985-4aa8-8661-059e93c228d0 service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:26.907590 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 675/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:31.258659 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:31.260178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:31.260827 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:31.263025 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 666/1341] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:31.268646 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7c62-01f0-4977-b04f-411c9df8c29b None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:31.269166 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7c62-01f0-4977-b04f-411c9df8c29b None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:31.269166 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7c62-01f0-4977-b04f-411c9df8c29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:31.276327 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=100 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:31.344190 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-49eb7c62-01f0-4977-b04f-411c9df8c29b None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:31.345296 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-49eb7c62-01f0-4977-b04f-411c9df8c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:31.453419 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 676/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:31.493944 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:31.496253 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:31.550408 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:31.597353 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a83ce1-7b45-4e72-a742-2d734e96ac0c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:31.601612 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:31.602267 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:31.602518 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:31.603172 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:31.613155 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:31.614745 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee19fe-bc66-4b77-8aea-9c530b4dba6a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:31.624945 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 667/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:34.412787 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:34.413371 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:34.413681 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:34.415173 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 677/1344] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:34.420526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7604-7c59-420d-904c-e906622a0c3a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:34.420976 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7604-7c59-420d-904c-e906622a0c3a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:34.421093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7604-7c59-420d-904c-e906622a0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:34.449456 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-80ac7604-7c59-420d-904c-e906622a0c3a None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:34.450856 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-80ac7604-7c59-420d-904c-e906622a0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:34.539722 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 668/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:34.576540 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:34.578619 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:34.592490 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1c3c5-ca57-4c72-9513-caae5e099784 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:34.596143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:34.596778 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:34.597056 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:34.597304 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:34.607428 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:34.609230 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db4072-70cc-474a-948b-71281479c3a5 service neutron] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:34.619115 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 678/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:39.002834 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be165db-691d-411a-b7e1-ba75537339f1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:39.003392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be165db-691d-411a-b7e1-ba75537339f1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:39.003392 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be165db-691d-411a-b7e1-ba75537339f1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:39.004740 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 669/1347] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:39.010678 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901073-d306-4366-8e0f-7d52e0b36538 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:39.011143 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901073-d306-4366-8e0f-7d52e0b36538 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:39.011250 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901073-d306-4366-8e0f-7d52e0b36538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:39.030504 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-3f901073-d306-4366-8e0f-7d52e0b36538 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:39.031760 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-3f901073-d306-4366-8e0f-7d52e0b36538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:39.041172 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 679/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:39.078851 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be165db-691d-411a-b7e1-ba75537339f1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:39.090568 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be165db-691d-411a-b7e1-ba75537339f1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:39.094339 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd09cd3eee934b22b8b3cad100e8f930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:39.094986 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:39.095272 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:39.095551 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:39.107313 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:39.108875 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770659-86a0-46da-b209-ab2c69be7ac0 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:39.119093 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 670/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:44.467373 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeafac9-7fac-4aed-8679-7876e58afa77 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:44.468372 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeafac9-7fac-4aed-8679-7876e58afa77 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:44.468915 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeafac9-7fac-4aed-8679-7876e58afa77 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:44.470992 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 680/1350] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 19:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:44.477360 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccff2-a1ba-4624-9529-942af4406fb4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:44.478661 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccff2-a1ba-4624-9529-942af4406fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:44.479278 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dccff2-a1ba-4624-9529-942af4406fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:44.643984 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a6dccff2-a1ba-4624-9529-942af4406fb4 None None] MFA Rules not processed for user `d0dc66acf6574140b71b6f57cb838652`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:44.645536 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a6dccff2-a1ba-4624-9529-942af4406fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:44.687425 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:44.745371 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 671/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 19:49:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:48.786594 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16ae2-3ff6-467d-80f7-367ffec33ee4 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:48.787159 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16ae2-3ff6-467d-80f7-367ffec33ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:48.787406 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16ae2-3ff6-467d-80f7-367ffec33ee4 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:48.789086 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 681/1352] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 19:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:48.794587 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be3eb4-6cfa-4380-a993-3df41841ceee None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:48.795087 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be3eb4-6cfa-4380-a993-3df41841ceee None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:48.795178 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be3eb4-6cfa-4380-a993-3df41841ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:48.813817 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-09be3eb4-6cfa-4380-a993-3df41841ceee None None] MFA Rules not processed for user `d0dc66acf6574140b71b6f57cb838652`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:48.815067 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-09be3eb4-6cfa-4380-a993-3df41841ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:48.823953 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 672/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:49.024863 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=72 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:49:50.363208 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e1ba-2716-4144-8b8c-7b92dcd6ca0d None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:50.363836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e1ba-2716-4144-8b8c-7b92dcd6ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:50.363836 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e1ba-2716-4144-8b8c-7b92dcd6ca0d None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:50.365175 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 682/1354] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 19:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:50.370333 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19990e7-34f3-4ba4-b69c-7bfd77ce14ee None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:50.370782 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19990e7-34f3-4ba4-b69c-7bfd77ce14ee None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:50.370989 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19990e7-34f3-4ba4-b69c-7bfd77ce14ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:50.389785 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e19990e7-34f3-4ba4-b69c-7bfd77ce14ee None None] MFA Rules not processed for user `d0dc66acf6574140b71b6f57cb838652`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:50.391103 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e19990e7-34f3-4ba4-b69c-7bfd77ce14ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:50.400237 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 673/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 19:49:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:54.328547 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f5bf-68e4-4b00-87de-c4ddf182873f None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:54.329138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f5bf-68e4-4b00-87de-c4ddf182873f None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:54.329138 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3f5bf-68e4-4b00-87de-c4ddf182873f None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:54.330730 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 683/1356] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:54.336280 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9a02-9eae-486b-8d1e-709e2b7ce1d9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:54.336697 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9a02-9eae-486b-8d1e-709e2b7ce1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:54.336846 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9a02-9eae-486b-8d1e-709e2b7ce1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:54.356315 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d49d9a02-9eae-486b-8d1e-709e2b7ce1d9 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:54.357520 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d49d9a02-9eae-486b-8d1e-709e2b7ce1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:54.365610 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 674/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:54.421134 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf433-70c0-482b-a896-90c0cea905b9 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:54.421432 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf433-70c0-482b-a896-90c0cea905b9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:54.421705 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf433-70c0-482b-a896-90c0cea905b9 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:54.423113 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 684/1358] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 19:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:54.430244 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53621015-4810-40d7-81aa-b1e39c71ebd8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:54.430541 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53621015-4810-40d7-81aa-b1e39c71ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:54.430850 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53621015-4810-40d7-81aa-b1e39c71ebd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:54.505577 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-53621015-4810-40d7-81aa-b1e39c71ebd8 None None] MFA Rules not processed for user `973379ffb05f4e819502f1ede6635aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:54.507121 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-53621015-4810-40d7-81aa-b1e39c71ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:54.594336 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 675/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 19:49:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 19:49:54.602466 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf433-70c0-482b-a896-90c0cea905b9 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:54.618028 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf433-70c0-482b-a896-90c0cea905b9 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:54.624104 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973379ffb05f4e819502f1ede6635aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:54.624757 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:54.625037 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:54.625313 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:54.635584 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:54.637182 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9884a4-507c-4d44-af64-7682b835cb40 service nova] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:54.649667 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 685/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 19:49:57.061939 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45abf-57dc-4518-9392-85d06b70a98a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:57.062443 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45abf-57dc-4518-9392-85d06b70a98a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:57.062526 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a45abf-57dc-4518-9392-85d06b70a98a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:57.065767 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 676/1361] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:57.069609 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49ec3-b19a-4c72-a47c-acb0f04a4a2d None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:57.070024 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49ec3-b19a-4c72-a47c-acb0f04a4a2d None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:57.070321 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a49ec3-b19a-4c72-a47c-acb0f04a4a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:57.091783 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-06a49ec3-b19a-4c72-a47c-acb0f04a4a2d None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:57.093003 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-06a49ec3-b19a-4c72-a47c-acb0f04a4a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:57.102207 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 686/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:57.146545 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a45abf-57dc-4518-9392-85d06b70a98a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:57.162830 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a45abf-57dc-4518-9392-85d06b70a98a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:57.169481 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973379ffb05f4e819502f1ede6635aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:57.171135 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:57.171609 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:57.172106 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:57.181861 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:57.183569 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867fb87-7ae4-460b-a07c-f85dc7b1b571 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:57.200070 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 677/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:49:59.725847 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388abba-af05-4c49-93f1-677ad5e4a99e None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:59.726378 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388abba-af05-4c49-93f1-677ad5e4a99e None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:59.726501 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388abba-af05-4c49-93f1-677ad5e4a99e None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:59.728570 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 687/1364] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:59.734132 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1feba-f233-4dfc-b047-62dda943fbb5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:59.734556 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1feba-f233-4dfc-b047-62dda943fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:59.734896 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1feba-f233-4dfc-b047-62dda943fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:59.759338 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e7d1feba-f233-4dfc-b047-62dda943fbb5 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:59.760645 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e7d1feba-f233-4dfc-b047-62dda943fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:59.769210 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 678/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:59.813530 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa21c4-47d5-4698-a2c3-4a23714822f9 None None] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:59.813784 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa21c4-47d5-4698-a2c3-4a23714822f9 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:59.814295 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa21c4-47d5-4698-a2c3-4a23714822f9 None None] PATH_INFO: `/` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:59.815647 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 688/1366] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 19:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:49:59.821823 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5c1d-6d50-440b-b7fc-afe2e44328dc None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:59.822138 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5c1d-6d50-440b-b7fc-afe2e44328dc None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:59.822430 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba5c1d-6d50-440b-b7fc-afe2e44328dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:59.842450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3aba5c1d-6d50-440b-b7fc-afe2e44328dc None None] MFA Rules not processed for user `973379ffb05f4e819502f1ede6635aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:49:59.843706 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3aba5c1d-6d50-440b-b7fc-afe2e44328dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:49:59.854072 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 679/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:49:59.861861 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa21c4-47d5-4698-a2c3-4a23714822f9 None None] Authenticating user token {{(pid=80283) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:49:59.877398 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa21c4-47d5-4698-a2c3-4a23714822f9 None None] Validating token access rules against request {{(pid=80283) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:49:59.883788 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973379ffb05f4e819502f1ede6635aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80283) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:49:59.884781 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] REQUEST_METHOD: `GET` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:49:59.885254 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:49:59.885740 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:49:59.896545 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:49:59.898596 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c8ebb-29d0-489b-81ac-46929744ea1e service nova] RBAC: Authorization granted {{(pid=80283) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:49:59.911027 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 689/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 19:50:00.620193 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54caf-994a-4d90-a594-11941b256bb8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:50:00.620640 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54caf-994a-4d90-a594-11941b256bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:50:00.620761 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b54caf-994a-4d90-a594-11941b256bb8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:50:00.622148 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 680/1369] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:50:00.629637 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a241-1e98-4f50-8f30-3cabd6743cc4 None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:50:00.629937 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a241-1e98-4f50-8f30-3cabd6743cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:50:00.630218 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3a241-1e98-4f50-8f30-3cabd6743cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:50:00.649351 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-afc3a241-1e98-4f50-8f30-3cabd6743cc4 None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:50:00.650752 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-afc3a241-1e98-4f50-8f30-3cabd6743cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:50:00.663464 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 690/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:50:02.219451 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950088-904d-473d-b443-3376746676df None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:50:02.220031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950088-904d-473d-b443-3376746676df None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:50:02.220031 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1950088-904d-473d-b443-3376746676df None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:50:02.221486 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 681/1371] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:50:02.226810 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232613d-9cbb-4d32-a142-0d0e6e811baa None None] REQUEST_METHOD: `POST` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:50:02.227248 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232613d-9cbb-4d32-a142-0d0e6e811baa None None] SCRIPT_NAME: `/identity` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:50:02.227345 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232613d-9cbb-4d32-a142-0d0e6e811baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80283) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:50:02.245604 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.auth.core [None req-7232613d-9cbb-4d32-a142-0d0e6e811baa None None] MFA Rules not processed for user `39d45c6601e340739e7025d543a6a1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80283) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:50:02.246832 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG keystone.common.fernet_utils [None req-7232613d-9cbb-4d32-a142-0d0e6e811baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80283) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:50:02.255264 dv-cinder-835881-13-smb devstack@keystone.service[80283]: [pid: 80283|app: 0|req: 691/1372] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 19:50:02.299261 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950088-904d-473d-b443-3376746676df None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:50:02.315083 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1950088-904d-473d-b443-3376746676df None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:50:02.321030 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '973379ffb05f4e819502f1ede6635aff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff18dab8a2a45ae9d807718a7c7b995', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:50:02.321713 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:50:02.322094 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:50:02.322370 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:50:02.330955 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:50:02.332579 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91e8b1-637d-4ce7-a1ee-f3df25b13819 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:50:02.342191 dv-cinder-835881-13-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 682/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 19:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 19:50:12.240292 dv-cinder-835881-13-smb devstack@keystone.service[80283]: DEBUG dbcounter [-] [80283] Writing DB stats keystone:SELECT=21 {{(pid=80283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:50:12.338450 dv-cinder-835881-13-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:50:24.495766 dv-cinder-835881-13-smb devstack@keystone.service[80272]: Thu May 19 19:50:24 2022 - graceful shutdown triggered... May 19 19:50:24.496277 dv-cinder-835881-13-smb devstack@keystone.service[80283]: Gracefully killing worker 1 (pid: 80283)... May 19 19:50:24.495866 dv-cinder-835881-13-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 19:50:24.497728 dv-cinder-835881-13-smb devstack@keystone.service[80284]: Gracefully killing worker 2 (pid: 80284)... May 19 19:50:25.497025 dv-cinder-835881-13-smb devstack@keystone.service[80272]: worker 1 buried after 1 seconds May 19 19:50:25.497025 dv-cinder-835881-13-smb devstack@keystone.service[80272]: worker 2 buried after 1 seconds May 19 19:50:25.497025 dv-cinder-835881-13-smb devstack@keystone.service[80272]: goodbye to uWSGI. May 19 19:50:25.499460 dv-cinder-835881-13-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 19:50:25.500334 dv-cinder-835881-13-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 19:56:18.773455 dv-cinder-835881-13-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 19:56:18.781007 dv-cinder-835881-13-smb devstack@keystone.service[144048]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 19:56:18 2022] *** May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: nodename: dv-cinder-835881-13-smb May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: machine: x86_64 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: clock source: unix May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: pcre jit disabled May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: detected number of CPU cores: 4 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: current working directory: / May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: detected binary path: /usr/bin/uwsgi-core May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: your processes number limit is 47680 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: your memory page size is 4096 bytes May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: detected max file descriptor number: 2048 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: lock engine: pthread robust mutexes May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: thunder lock: enabled May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 19:56:18.784997 dv-cinder-835881-13-smb devstack@keystone.service[144048]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 19:56:18.829228 dv-cinder-835881-13-smb devstack@keystone.service[144048]: Python main interpreter initialized at 0x563fe8df09c0 May 19 19:56:18.829228 dv-cinder-835881-13-smb devstack@keystone.service[144048]: python threads support enabled May 19 19:56:18.829228 dv-cinder-835881-13-smb devstack@keystone.service[144048]: your server socket listen backlog is limited to 100 connections May 19 19:56:18.829228 dv-cinder-835881-13-smb devstack@keystone.service[144048]: your mercy for graceful operations on workers is 90 seconds May 19 19:56:18.829665 dv-cinder-835881-13-smb devstack@keystone.service[144048]: mapped 403077 bytes (393 KB) for 2 cores May 19 19:56:18.829665 dv-cinder-835881-13-smb devstack@keystone.service[144048]: *** Operational MODE: preforking *** May 19 19:56:18.829889 dv-cinder-835881-13-smb devstack@keystone.service[144048]: *** uWSGI is running in multiple interpreter mode *** May 19 19:56:18.829889 dv-cinder-835881-13-smb devstack@keystone.service[144048]: spawned uWSGI master process (pid: 144048) May 19 19:56:18.830157 dv-cinder-835881-13-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 19:56:18.830725 dv-cinder-835881-13-smb devstack@keystone.service[144048]: spawned uWSGI worker 1 (pid: 144062, cores: 1) May 19 19:56:18.834293 dv-cinder-835881-13-smb devstack@keystone.service[144048]: spawned uWSGI worker 2 (pid: 144063, cores: 1) May 19 19:56:18.834293 dv-cinder-835881-13-smb devstack@keystone.service[144048]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 19:56:24.489061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:56:24.489061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: from cryptography.utils import int_from_bytes May 19 19:56:24.489979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:56:24.489979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: from cryptography.utils import int_from_bytes May 19 19:56:24.490122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:56:24.490122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: from cryptography.utils import int_from_bytes May 19 19:56:24.490587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 19:56:24.490587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: from cryptography.utils import int_from_bytes May 19 19:56:24.539272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:56:24.539571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:56:24.539730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 19:56:24.539942 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] command line args: [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:56:24.540112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 19:56:24.540328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] command line args: [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 19:56:24.540472 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:56:24.540569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ================================================================================ {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:56:24.540803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 19:56:24.540961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] admin_token = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.541109 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ================================================================================ {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 19:56:24.541406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] config_dir = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.541544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] admin_token = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.541703 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] config_source = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] config_dir = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] debug = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542347 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.542907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] config_source = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] debug = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] insecure_debug = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.543892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] insecure_debug = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_config_append = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_dir = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_file = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.544958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_config_append = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545602 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545602 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_dir = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.545903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_file = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546540 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.546996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.547901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] notification_format = cadf {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548148 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548431 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] notification_format = cadf {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.548977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] publish_errors = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549143 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.549957 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] publish_errors = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] standard_threads = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] strict_password_check = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.550894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] use_eventlog = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] use_journal = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] use_json = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] use_stderr = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] use_syslog = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.551948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] watch_log_file = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.552080 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.552204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.552352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.552494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.552629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.552755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] standard_threads = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.552872 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.552982 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] strict_password_check = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.553116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.553238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.553355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.553471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] use_eventlog = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.553471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] use_journal = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.553704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.553834 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] use_json = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.553957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.554068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] use_stderr = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.554068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] use_syslog = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.554276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.554386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] watch_log_file = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 19:56:24.554501 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.554629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.554846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555031 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555314 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555314 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.555969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556234 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.556919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557868 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.557996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558507 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558507 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.558923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.559959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560631 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560761 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.560761 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.561995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.562985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.563926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564873 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.564999 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565144 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.565990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566401 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.566846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567214 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567551 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567691 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.567958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.568948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569225 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569773 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.569911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570051 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.570897 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571492 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.571939 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572091 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572379 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.572925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573329 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.enabled = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.573898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.574886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575015 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.enabled = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575557 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575689 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575817 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.575956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576356 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576759 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.576904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577044 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.577994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.578275 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.578449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.578592 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.578773 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.578917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579196 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579332 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.579900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.580876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581101 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581633 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581797 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.581961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.external = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.582125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.582289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.mapped = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.582464 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.582670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.582870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.583042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.583248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.583458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.password = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.583632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.583834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] auth.token = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.external = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.mapped = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] catalog.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.584934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.585114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.585286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.585460 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.password = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.585634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.585839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] auth.token = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.586026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.586200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.586387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.586578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] catalog.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.586802 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587483 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.587899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588172 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588726 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.588995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.589783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590193 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.590967 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.591093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.591338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.591512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.591697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.591863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.592038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.592038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.592466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.592650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.592830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593009 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593188 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593388 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.593972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594139 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.594971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.595138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.595316 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.595517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.595722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.595914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596798 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.596945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597081 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597359 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.597898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598590 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.598878 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.599975 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.600903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601433 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.601951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.602112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.602288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.602465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.602994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.603204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.603386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.603587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.603772 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.603944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.604961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.605125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.605314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.605503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.605698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.605893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.606089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.606269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.606469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.606666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.606833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607176 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607596 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.password = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.607986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608258 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608397 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608654 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.608907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609172 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.password = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609848 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.609977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610535 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610535 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.610862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.611996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.612177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.612177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.612530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.612530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.612898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.613089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.613285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.613464 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.613663 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.613852 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.614873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.615050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.615227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.615441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.615621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.615829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616533 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616661 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.616927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617695 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.617948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.618082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.618228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.618370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.618505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.618639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.619989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620801 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] policy.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.620909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621491 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] receipt.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] policy.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.621956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.622728 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] receipt.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623606 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.623977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624543 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624801 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.624956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625214 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] revoke.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.625911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] role.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626139 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] role.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626257 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] revoke.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] role.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626486 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626613 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] role.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626873 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.626985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] role.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627106 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] role.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] role.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] role.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.627902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628265 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628720 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.628947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629610 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.629885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630025 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630025 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630413 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.630913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.631985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632120 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.632960 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633216 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633626 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.633895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634607 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.634903 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635399 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635654 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.635920 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.provider = fernet {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636732 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.636878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637144 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.provider = fernet {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.637941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] trust.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.638934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] trust.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639640 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639789 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.639920 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640316 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.connection = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.640982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641111 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641263 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641263 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.connection = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.641968 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642109 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642495 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642630 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.642916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643714 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.643985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644637 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.644913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645062 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645207 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645607 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 19:56:24.645746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 19:56:24.658405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.658648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.658986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.659085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.659236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.659236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.667811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.667989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.696312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.696543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.696665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.696921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.749635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.749792 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.800787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.800992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.801485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.801704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.866358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.866563 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.866832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.866985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867328 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867488 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.867943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.890467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.890897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891860 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.891931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.892004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.892084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.892084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.903196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.903665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.917749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.917946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.918160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.918416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.918637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.918861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.919102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144062) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.919731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.919970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.920222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.920451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.920671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.920887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.921102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144063) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 19:56:24.936785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.936983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:56:24.937321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.937482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:56:24.937781 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.937933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.938024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.938202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:56:24.938316 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.938479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.938583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.938759 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 19:56:24.938996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.939257 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.939515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.939773 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.949687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.949964 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.950239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.950522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.950850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.951132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.951402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.951688 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.958726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.959812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.962021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.962255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.962570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.962988 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.963247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.963971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964553 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.964909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.965013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.965284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.965558 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.965824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.992000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.992571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.993648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.993936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.994187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.994472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.999373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:24.999716 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:24.999909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.000019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.000166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.000472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.007303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.007590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.007730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.008045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.012227 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.012515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.012667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.012825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.012925 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013656 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.013959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.014052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.014142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.014273 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.014558 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.033037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.033222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.033352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.033499 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.037856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.038017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.041525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.041665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.041835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.041930 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.046831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.046988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.050411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.050568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.054248 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.054408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.054546 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.054664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.054848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.054946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.055910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.074588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.074906 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.075058 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.075227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.075318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.075503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.075642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.075791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.083446 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.083798 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.085522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.085660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.085840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.085931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.088876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.089015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.089192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.089959 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.090099 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.103820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.103978 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.104143 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104656 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.104918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.105011 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.105204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.105343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.105493 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.105604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.123674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.123812 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.126935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.127092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.130227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.130384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.131832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.131969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.133498 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.133658 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.133748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.133850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.134020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.134120 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.141494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.141667 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.143142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.143309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.146357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.146514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.146610 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.146726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.146943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.147109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.147199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.147295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.156551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.156690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.156893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.157056 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.157157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.157266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=144063) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.165161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=144062) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 19:56:25.165260 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.165971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.166882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.167959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=144063) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.168643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=144062) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 19:56:25.207088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563fe8df09c0 pid: 144063 (default app) May 19 19:56:25.207434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563fe8df09c0 pid: 144062 (default app) May 19 19:56:25.210493 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f17b-ee84-4ebe-aa70-52971fdb2012 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:25.210816 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f17b-ee84-4ebe-aa70-52971fdb2012 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:25.211096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f17b-ee84-4ebe-aa70-52971fdb2012 None None] PATH_INFO: `/v3` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:25.217953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu May 19 19:56:25 2022] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:33.211580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:33.212527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:33.212527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:33.219738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:33.225553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:33.226014 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:33.226117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:33.295581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: INFO dbcounter [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] Registered counter for database keystone May 19 19:56:33.320382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG oslo_db.sqlalchemy.engines [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:56:33.328719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writer thread running {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:56:33.518497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG passlib.handlers.bcrypt [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=144063) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:56:33.518883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG passlib.handlers.bcrypt [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=144063) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:56:33.575159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:33.576831 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:33.713110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 19:56:33.737791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:33.818882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: INFO dbcounter [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] Registered counter for database keystone May 19 19:56:33.840757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG oslo_db.sqlalchemy.engines [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 19:56:33.850127 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writer thread running {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 19:56:33.970849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef83739-2a81-4a6d-89b7-120d79ec93d4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:33.976144 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3444a3ecd54495b9846ca0dce0475a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:33.976822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:33.977102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:33.977379 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:33.986907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:34.040045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:56:34.040385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83eb1a7-0ad0-4736-9b43-ce010a64aae9 admin admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:34.051410 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 19:56:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:56:34.061024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:34.076790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae055010-8642-44c6-8024-28b4292ec5e9 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:34.083271 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3444a3ecd54495b9846ca0dce0475a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:34.084408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:34.084812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:34.085096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] PATH_INFO: `/v3/projects/da3444a3ecd54495b9846ca0dce0475a` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:34.086897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] RBAC: Authorizing `identity:get_project(project_id=da3444a3ecd54495b9846ca0dce0475a)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:34.247652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 19:56:34.248385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d174a87-f71a-40c2-97d3-29de0323c692 admin admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:34.252787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu May 19 19:56:34 2022] GET /identity/v3/projects/da3444a3ecd54495b9846ca0dce0475a => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:36.438481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aac83-c9a7-4a70-b9c6-9c6f2682e777 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:36.439440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aac83-c9a7-4a70-b9c6-9c6f2682e777 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:36.439440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aac83-c9a7-4a70-b9c6-9c6f2682e777 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:36.446306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:36.455014 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:36.455458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:36.455578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:36.477889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:36.479473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:36.489227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 19:56:36.521179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aac83-c9a7-4a70-b9c6-9c6f2682e777 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:36.536878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aac83-c9a7-4a70-b9c6-9c6f2682e777 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:36.542888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3444a3ecd54495b9846ca0dce0475a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:36.543538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:36.543819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:36.544127 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:36.552188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:36.554000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4450b2e-d1b7-4409-ac85-7c5af29a3cdd admin admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:36.562916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 19:56:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 19:56:36.568843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:36.582329 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea06ee0-ab59-4c27-90ae-9c9ceb8d0fb6 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:36.588485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3444a3ecd54495b9846ca0dce0475a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:36.589366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:36.589649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:36.589926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:36.591594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:36.593463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33e0b-3ee0-4b59-b9f6-cf2003e2ab7a admin admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:36.595084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu May 19 19:56:36 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:38.843306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d94f-9b73-41a2-83f3-f15899fdae89 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:38.843896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d94f-9b73-41a2-83f3-f15899fdae89 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:38.843896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8d94f-9b73-41a2-83f3-f15899fdae89 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:38.845186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:38.850647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:38.851124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:38.851237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:38.868990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:38.870206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:38.900542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734fe1-21bd-45cf-ab3c-16ff8d020df1 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:38.900746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734fe1-21bd-45cf-ab3c-16ff8d020df1 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:38.901002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f734fe1-21bd-45cf-ab3c-16ff8d020df1 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:38.902464 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:38.908290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:38.908723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:38.909010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:38.948529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG passlib.handlers.bcrypt [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=144062) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 19:56:38.948967 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG passlib.handlers.bcrypt [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=144062) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 19:56:38.953103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:38.976371 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:38.996860 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:38.998576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:39.001502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.083410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3872baa-9539-44eb-ad80-51a9558c6bef None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.108148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:39.126822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.127634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.127923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.128193 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.130674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.139965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:39.151381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:39.152441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:39.153517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:56:39.158357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.245283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.266093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b446-f9b0-47e1-92e5-0f53232e1383 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.304405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.305088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.305361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.305647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.306419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:39.306729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.308198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.321523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:56:39.327252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.348379 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58021c-5f5d-4a62-8f0e-700aeb1e2959 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.350770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.387909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.388827 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.389117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.389398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.434510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98a6d6-4f78-4ca4-820e-c9600c404d36 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.462304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.463922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.471813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.472713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.473006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.473290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.474509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.476010 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.477978 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 9/16] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:56:39.483519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.498029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.566632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 8/17] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:56:39.572372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.575250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.583682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d7486-be9e-4666-af66-6b00faa883d9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.618315 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.619190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.619708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.619708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.620956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.622580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.624244 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:56:39.630138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.675735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165ed29-9cb4-4a3f-91c0-581d5b8dec89 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.708433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.709609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.710436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.710748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.711019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.728756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b8be9-43e2-4708-b790-ccd715b89f39 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.730546 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.732102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:56:39.752901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:39.753917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:39.754899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:56:39.754899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:56:39.754899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:56:39.754899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:56:39.754899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:39.760006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:39.763938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.764614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.764902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.765184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.766033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.domain.id=default, user.id=296d7ae67cfb462aa7db38b0f4a6b740) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:39.766350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.767931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfa92a-5f06-4a69-8ed5-c1f531a03a45 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.775088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/role_assignments?user.id=296d7ae67cfb462aa7db38b0f4a6b740&scope.domain.id=default&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:56:39.822339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:39.873000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c3f3-d6e8-4ba5-8c07-c8f1556a87e2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:39.910963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:39.911659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:39.911941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:39.912220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:39.912969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:39.913258 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:39.914724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680398b5-8b8d-4772-a6a2-3f75262ca792 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:39.935160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:42.242645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8144-17b2-4ad8-bc1e-f901d61fc7ec None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.243750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8144-17b2-4ad8-bc1e-f901d61fc7ec None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.244303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8144-17b2-4ad8-bc1e-f901d61fc7ec None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.245945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:42.252193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559f6e2-a808-4881-ae3c-cbb29b97971e None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.252718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559f6e2-a808-4881-ae3c-cbb29b97971e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.252800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559f6e2-a808-4881-ae3c-cbb29b97971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.276159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-0559f6e2-a808-4881-ae3c-cbb29b97971e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:42.277380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-0559f6e2-a808-4881-ae3c-cbb29b97971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:42.368458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:42.404153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f8144-17b2-4ad8-bc1e-f901d61fc7ec None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:42.556453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f8144-17b2-4ad8-bc1e-f901d61fc7ec None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:42.598377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:42.599697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.600230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.600717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.621424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:42.624409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9a558-fd62-4998-886a-9f27f67aae1d None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.624996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9a558-fd62-4998-886a-9f27f67aae1d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.625516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9a558-fd62-4998-886a-9f27f67aae1d None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.627207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 12/24] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:42.635361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:42.636251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 13/25] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:56:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:42.638635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:42.639434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.639959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.640446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.646734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:42.686654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:42.688301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:42.748405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b1ad-a7ea-4a08-83fc-0eccf842e21a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:42.787702 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:42.788858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:42.790044 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:42.790493 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:42.796069 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:42.796571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:42.798159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:42.803001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:42.811551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 14/26] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:42.818222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:42.854431 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 13/27] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:42.886086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:42.927233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:42.967364 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefb43d-793d-43cb-8835-5a563464283f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.016385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.017757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.018214 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.018658 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.020903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.022566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266513af-f874-4618-9b09-ab579ebe9f26 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.024562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 15/28] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:42 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:43.029212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e071fc-8504-467c-b1d1-438543fa5a3b None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.029737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e071fc-8504-467c-b1d1-438543fa5a3b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.031399 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e071fc-8504-467c-b1d1-438543fa5a3b None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.033097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 16/29] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:43.035243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e071fc-8504-467c-b1d1-438543fa5a3b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.055942 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902f17e-9ea5-4f2a-b789-877a6fdee161 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.131352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.132190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.132479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.132761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.154930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.156495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b9ab404b-4c44-43a7-8a7c-b455268f8d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:56:43.183796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:43.184840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:43.185947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:56:43.185947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:56:43.185947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:56:43.185947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:56:43.196507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 14/30] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:43.198005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.198520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.199037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.215434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e071fc-8504-467c-b1d1-438543fa5a3b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.219775 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:43.227959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:43.257424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.258263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.258550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.258889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.260857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.262362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.264396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 17/31] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:43.264984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.275036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:43.276848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:43.333131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 15/32] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:43.334737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.391462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9b50b-3459-4a06-b321-0978a9103f02 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.437673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.438922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.439275 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.439627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.440714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:43.441112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.443272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c928a6-383f-4417-9e1e-abcbc410d1a3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.459294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f412c2-7790-443b-898e-4a2800c2ca75 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.468184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 18/33] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:43.471943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebfbd-3268-4777-a87e-9b6326f6dffa None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.472967 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebfbd-3268-4777-a87e-9b6326f6dffa None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.473862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ebfbd-3268-4777-a87e-9b6326f6dffa None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.476416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 19/34] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:43.478190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ebfbd-3268-4777-a87e-9b6326f6dffa None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.510134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.511550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.512050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.512707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] PATH_INFO: `/v3/domains/default/users/296d7ae67cfb462aa7db38b0f4a6b740/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.515664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=296d7ae67cfb462aa7db38b0f4a6b740, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.517726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.556385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:43.598956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ebfbd-3268-4777-a87e-9b6326f6dffa None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.635808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.636627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.636903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.637072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.637828 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.639400 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c01d0-be81-4542-a26b-62dcea3cfb96 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.663509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 16/35] 10.222.0.77 () {58 vars in 1361 bytes} [Thu May 19 19:56:43 2022] PUT /identity/v3/domains/default/users/296d7ae67cfb462aa7db38b0f4a6b740/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:56:43.665313 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.689407 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:43.770308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 20/36] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:56:43 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:43.771558 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.771851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.772148 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.786933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2dab5-f565-4c4c-95ec-288d9dee0407 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:43.792790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:43.794367 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:43.830037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:43.831779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:43.832318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:43.832809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:43.833859 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:43.836038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b5624-2f7b-4b39-a83e-d462a98ba464 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:43.876324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 21/37] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:43.877585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 17/38] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:56:43 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:43.903517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:43.971951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:44.041043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109659f4-89fe-40e6-a198-c82767895a13 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:44.098129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:44.098909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.099195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.099478 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.100262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:44.101853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca3546-6bbf-4cd6-8db2-b839329ee3bc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:44.120500 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 22/39] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:56:43 2022] POST /identity/v3/roles => generated 225 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:44.267237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1049-82a3-4a3d-bac8-ccf9e889a755 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.267237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1049-82a3-4a3d-bac8-ccf9e889a755 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.267237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1049-82a3-4a3d-bac8-ccf9e889a755 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.267237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 18/40] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:44.273842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f83-e006-4409-ad4b-4389a6c4065d None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.274360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f83-e006-4409-ad4b-4389a6c4065d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.274466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc10f83-e006-4409-ad4b-4389a6c4065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.295283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3cc10f83-e006-4409-ad4b-4389a6c4065d None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:44.296509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3cc10f83-e006-4409-ad4b-4389a6c4065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:44.380632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 23/41] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:44.403640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1049-82a3-4a3d-bac8-ccf9e889a755 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:44.436078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba149e-a2a8-4eb0-ad0c-5eb0b03cf143 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.436427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba149e-a2a8-4eb0-ad0c-5eb0b03cf143 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.436668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba149e-a2a8-4eb0-ad0c-5eb0b03cf143 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.438256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 24/42] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:44.443451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.443742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.444023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.461941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:44.463444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:44.484611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:44.501871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:44.522460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1049-82a3-4a3d-bac8-ccf9e889a755 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:44.536415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 25/43] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:44.558250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:44.559006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.559131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:44.559341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.559678 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.560422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:44.561932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:44.578645 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 19/44] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:56:44 2022] POST /identity/v3/roles => generated 223 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:44.678859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21438-43b4-4863-ad76-ac3bff64e370 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:44.716808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:44.717714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.718010 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.718294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.719636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:44.721162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec1409-87e2-4f45-b661-041bef2d1b46 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:44.723152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 26/45] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:56:44.729130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:44.839389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0b464-86a5-4f61-b1db-1ff2999734b0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:44.867716 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:44.874776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:44.875465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:44.875756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:44.876037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:44.876779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:44.878273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be098a41-4f04-4ba4-878a-ee2b999edd4f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:44.905312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 20/46] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:56:44 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:46.266426 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e138f-ac73-4337-a75c-eb605499f070 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:46.267023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e138f-ac73-4337-a75c-eb605499f070 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:46.267023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e138f-ac73-4337-a75c-eb605499f070 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:46.268454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 27/47] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:46.273998 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:46.274434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:46.274565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:46.292489 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:46.294131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:46.364254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 21/48] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:46.387219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e138f-ac73-4337-a75c-eb605499f070 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:46.433122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:46.494197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e138f-ac73-4337-a75c-eb605499f070 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:46.529460 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:46.530191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:46.530479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:46.530837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:46.541263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:46.549020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:46.549977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:46.550883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 28/49] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:46.556375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:46.659136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309978a-46ad-478e-9ba3-b38b53d747a4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:46.673108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:46.695398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:46.696092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:46.696476 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:46.696760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:46.697527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:46.697846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:46.699356 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:46.711702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 22/50] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:46.717517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:46.819261 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:46.822789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e34cd2-8ddb-4b46-a404-644c763b237e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:46.858376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:46.859377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:46.859667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:46.859948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:46.861209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:46.862725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:46.864626 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 29/51] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:46 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:46.870026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:46.975218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e5728-42bf-49f4-ab4e-6c9fe1ecd8aa None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:47.010526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615d111-6fd9-4635-9394-f603777489af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:47.011375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d111-6fd9-4635-9394-f603777489af None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.011665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d111-6fd9-4635-9394-f603777489af None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.011947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615d111-6fd9-4635-9394-f603777489af None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.013245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615d111-6fd9-4635-9394-f603777489af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:47.014718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615d111-6fd9-4635-9394-f603777489af None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:47.016400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 23/52] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:47.022214 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:47.125594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93338d-72a8-4247-bfc3-5afc4e75579f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:47.134713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0d04-2df8-41ea-9371-6475d3f49443 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.135122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0d04-2df8-41ea-9371-6475d3f49443 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.135495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0d04-2df8-41ea-9371-6475d3f49443 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.136941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 24/53] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:47.142028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.142436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.142728 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.159911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:47.160288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:47.160972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.161100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:47.161265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.161545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.162396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.domain.id=default, user.id=296d7ae67cfb462aa7db38b0f4a6b740) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:47.162755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:47.164227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:47.170496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 30/54] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 19:56:47 2022] GET /identity/v3/role_assignments?user.id=296d7ae67cfb462aa7db38b0f4a6b740&scope.domain.id=default&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:47.200345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:47.237722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 25/55] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:47.261763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:47.301392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:47.381594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467991db-1dd6-4d27-aa53-cc27056899b9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:47.415986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:47.416796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.417083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.417365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.418534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:47.420076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61045028-e3b2-4f64-a5c1-8af369557151 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:47.421738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 31/56] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:47.430418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:47.531628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d25c-071a-42e3-97f0-152838da2bb9 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:47.566779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:47.567442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:47.567724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:47.568004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:47.568712 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:47.570188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bab08-73b1-451a-98ca-51b57b261bae None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:47.603737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 26/57] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 19:56:47 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:49.832802 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbef8-851b-4b25-b964-d8d8d69458ce None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:49.833365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbef8-851b-4b25-b964-d8d8d69458ce None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:49.833365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbef8-851b-4b25-b964-d8d8d69458ce None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:49.834811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 32/58] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:49.841385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:49.842090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:49.842304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:49.865643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:49.866873 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:49.885188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:49.939030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 27/59] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:49.968120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dbef8-851b-4b25-b964-d8d8d69458ce None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:50.083597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:50.090444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dbef8-851b-4b25-b964-d8d8d69458ce None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:50.134705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:50.135603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:50.135830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:50.136110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:50.137455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:50.139047 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6db3d-4528-4030-b702-8550c6774e5a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:50.140678 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 33/60] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:50.146479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:50.257220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143342c-0b36-4c6e-a8c1-5bf5f88fe6a1 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:50.294634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:50.295342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:50.295626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:50.295863 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:50.296636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:50.298089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b90ec-3147-46c3-9acc-283a1f4cdf24 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:50.324343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 28/61] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:56:50 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:53.642594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c237-e92c-4c5f-afb3-449c29db1424 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:53.643603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c237-e92c-4c5f-afb3-449c29db1424 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:53.644117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c237-e92c-4c5f-afb3-449c29db1424 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:53.645734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 34/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:56:53.651138 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:53.651987 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:53.652478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:53.675769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:53.677005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:53.680110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:53.739500 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36836-7ec2-453a-b442-16d2b10b8e5a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:53.740180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36836-7ec2-453a-b442-16d2b10b8e5a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:53.740674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36836-7ec2-453a-b442-16d2b10b8e5a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:53.743740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 35/63] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:53.748431 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:53.749273 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:53.749764 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:53.774893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 29/64] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:53.776254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:53.777734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:53.798526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:53.894938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 36/65] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:56:53.953455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:53.965047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26a1d-1d5a-4670-8159-a68d011224cf None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.015188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.016369 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.016811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.017261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.027199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.032768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-62959b3d-6a06-49ec-8473-cffaba175e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:54.042568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:54.043787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:54.044822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:56:54.047268 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 30/66] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:56:54.049150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4717d-769b-4bba-a226-55088f370b18 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.049594 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4717d-769b-4bba-a226-55088f370b18 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.050039 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4717d-769b-4bba-a226-55088f370b18 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.051495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 31/67] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:54.056474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4717d-769b-4bba-a226-55088f370b18 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.080234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.083816 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476e168-77ea-4fde-89d9-5fa0d0716c9f None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.120107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.121214 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.121671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.122107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.133676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-73530fd6-85fe-489e-a1d1-2351f5997aeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:54.141789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:54.142993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:56:54.144018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:54.146384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 37/68] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:56:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:56:54.147873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.148322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.148777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.165915 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:54.167373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:54.174267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4717d-769b-4bba-a226-55088f370b18 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.211857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.212644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.213109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.213542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.214469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:54.215059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.216832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.228065 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 32/69] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:54.229294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.255012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 38/70] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:54.256099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.304680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.357509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b9d98-3db7-4700-b25b-a9db91cca1eb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.363181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.379895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04dfb6-bffd-4533-9d48-e210583ae47a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.398630 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.399611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.400081 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.400511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.401412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:54.401930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.403584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.412692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 33/71] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:54.413723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.422273 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.423206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.423493 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.423766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.440078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.441577 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.443362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 39/72] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:54.444126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.516142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c1977-b853-4f97-8e63-b956138b3f82 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.538217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.547039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a199-44ef-4b60-a060-46c2b747f2e4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.549137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.549965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.550248 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.550527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.560982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-4eef1042-3b06-4378-a9f3-976ddaf03ad9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:54.569040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:54.570020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:56:54.570957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 34/73] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:54.572843 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc329-6719-4f4c-ac1b-1d40d1a12f60 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.573144 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc329-6719-4f4c-ac1b-1d40d1a12f60 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.573436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cc329-6719-4f4c-ac1b-1d40d1a12f60 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 35/74] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1370ca-6f8d-4d07-a5ef-a33679cbbe3c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1370ca-6f8d-4d07-a5ef-a33679cbbe3c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1370ca-6f8d-4d07-a5ef-a33679cbbe3c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 36/75] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:54.578902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1370ca-6f8d-4d07-a5ef-a33679cbbe3c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.591917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.592834 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.593115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.593377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.594797 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.596589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.598544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 40/76] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:54.603790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.618932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.685969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1370ca-6f8d-4d07-a5ef-a33679cbbe3c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.710346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda58b1b-68c1-4ac6-8ae5-8036dd9f9d21 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:54.726321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.727023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.727620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.727907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.746032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:54.746950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.747067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.747306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.748220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:54.749725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.751832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b4d3c-31cc-4909-a5dd-5d12f2e3b5e6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.760641 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 41/77] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:54.761934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32bd9-3396-4af0-9b1c-132d2c81e82f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.762232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32bd9-3396-4af0-9b1c-132d2c81e82f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.762516 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e32bd9-3396-4af0-9b1c-132d2c81e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.779996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-27e32bd9-3396-4af0-9b1c-132d2c81e82f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:54.781194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-27e32bd9-3396-4af0-9b1c-132d2c81e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:54.784027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.800792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:54.802288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:54.845939 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 42/78] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:54.847231 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:54.847529 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:54.847813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:54.858661 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:54.864546 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:54.865741 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:54.914017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 37/79] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:56:54.915217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:54.932715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 43/80] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:54.938456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.003740 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.020881 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5dbf8-4759-41c1-a6e3-0704a2ab351b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.042307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59601a9-e597-431b-977c-e7eb15bf0692 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.057080 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.058110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.058397 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.058758 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.078946 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.079878 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.080135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.080416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.081674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.083203 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.084850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 44/81] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.085722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.089912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.131942 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.133733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.186346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39292-0716-4681-85c7-06ea9f1ca3c5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.219474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.221369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.222208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.222501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.222859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.233556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:55.237020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 38/82] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:56:55.238025 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:55.241292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:55.242480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 45/83] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:55.244046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.306194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.340467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da448909-fe81-473e-ad36-b2b6eaa5b92d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.345744 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf878-5276-44e5-b787-a6cef8c9aab3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.376738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.377619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.377911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.378197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.379414 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.379569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.380390 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.380681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.380886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.380986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.382130 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.382619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 39/84] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.383420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.383635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.385505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 46/85] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.386175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.438315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.484439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c3f9-2721-4026-85e9-c0194c6155db None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.486645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a207f-15b6-4d9f-a422-bf2787951bcf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.516039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.522148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.522351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.522845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.523124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.523240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.523407 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.523515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.523684 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.524865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.526351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.533003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 47/86] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.533003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.589471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.590990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.630481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750012e2-fc55-4e9e-ad97-55bf4d2d8b2d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.646664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.665466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.666124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.666415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.666714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.667477 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:55.667791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.669248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.677491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 48/87] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.677491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.701864 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 40/88] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:56:55.702764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.741951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.780404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f2d5-d873-4f69-9c4a-861f0994dfa7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.803090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964b72b-8daf-44f3-998c-9285238db108 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.814414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.815122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.815417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.815728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.816569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:55.816875 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.818350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.823810 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 49/89] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:55.824572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.847854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:55.849126 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:55.849424 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:55.849711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:55.850462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:55.852045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:55.876085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 41/90] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:56:55 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:56:55.877611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:55.904118 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:55.956163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b93292-dbd9-4cae-94dd-76aad3232f03 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:55.989663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:56.004217 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.005899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.006702 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.007154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.008494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=296d7ae67cfb462aa7db38b0f4a6b740) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:56.008993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.011832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.019993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 50/91] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/role_assignments?user.id=296d7ae67cfb462aa7db38b0f4a6b740&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:56.021156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:56.096976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edffe94-2646-4c96-8c92-8dbed2d0304e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:56.156654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.159691 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61f93-5584-4a5d-9282-969076598867 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:56.161374 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.161726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.162013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.163912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.166671 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.168939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 42/92] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:55 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:56.174177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:56.208860 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.210367 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.210872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.211578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.213919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.216451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.218829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 51/93] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:56:56 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:56.224712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:56.290252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:56.311096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:56.325054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba907c-c470-4302-a8e9-2693b80e86fd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:56.364777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c64ab-4ac7-4aff-ac04-b853a96ebfc8 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:56.369146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.369913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.370276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.370638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.454619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.456248 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.463429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.464128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.464417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.464698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.465563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:56.465883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.467541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.484929 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 52/94] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:56:56 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:56.579914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:56.624532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 43/95] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:56:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:56:56.635864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:56.785606 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487b88-181b-4a25-8e7d-b22b62d4a0d9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:56.809753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:56.822457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:56.823394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:56.823750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:56.824035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] PATH_INFO: `/v3/projects/2a8828e0e79548de9133afe4ff46cad1` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:56.825301 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=2a8828e0e79548de9133afe4ff46cad1)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:56.827013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba0044-8618-4166-8208-ab833203e6c1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:56.833763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 53/96] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:56:56 2022] GET /identity/v3/projects/2a8828e0e79548de9133afe4ff46cad1 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:56.835229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:56.967354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e823b-fe48-4185-a6eb-b56e2d3c0366 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:57.004254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:57.005336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:57.005861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:57.006350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:57.007494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=2a8828e0e79548de9133afe4ff46cad1, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:57.008043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:57.009733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a08cb8-badb-4655-9faf-7d2ec37d80a6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:57.018361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 44/97] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:56:56 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=2a8828e0e79548de9133afe4ff46cad1&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:58.952911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee93b-54ca-42d3-89a0-3c56f5322b46 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:58.953422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee93b-54ca-42d3-89a0-3c56f5322b46 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:58.953422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bee93b-54ca-42d3-89a0-3c56f5322b46 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:58.954770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 54/98] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:58.972731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079caaf-4c0e-422d-a4ca-3529844b6845 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:58.973260 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079caaf-4c0e-422d-a4ca-3529844b6845 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:58.973260 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079caaf-4c0e-422d-a4ca-3529844b6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:58.998729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4079caaf-4c0e-422d-a4ca-3529844b6845 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:58.999930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4079caaf-4c0e-422d-a4ca-3529844b6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:59.052180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:59.096643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 45/99] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:59.164097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee93b-54ca-42d3-89a0-3c56f5322b46 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:59.240484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ed8c7-c465-420d-af86-f4216a489f61 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.240828 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ed8c7-c465-420d-af86-f4216a489f61 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.241023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ed8c7-c465-420d-af86-f4216a489f61 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.243071 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 46/100] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:59.255754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.256171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.256338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.293158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:59.295172 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:59.388036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bee93b-54ca-42d3-89a0-3c56f5322b46 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:59.466894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:59.467726 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.468016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.468306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.483068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 47/101] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:56:59.491664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:59.499552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:59.500628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:56:59.501580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:59.507173 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 55/102] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:59.512763 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:59.522577 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:59.592764 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:59.652711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:59.657813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026038e-a5f2-4590-a782-29757fb12467 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:59.658036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93af3-77f0-4a8e-943e-d7f3ece329b4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:59.695215 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:59.696277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.696809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.697298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.698391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:56:59.698882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:59.699173 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:59.700089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.700513 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.700860 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.701347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703727-0300-493f-ba59-ae9459930ae4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:59.710520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 48/103] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:59.715201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:56:59.716904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac60-884c-4aa7-8215-9f0e590ae7f3 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.717434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac60-884c-4aa7-8215-9f0e590ae7f3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.717918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac60-884c-4aa7-8215-9f0e590ae7f3 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.719527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 49/104] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:59.721089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298366-3bd4-4326-bead-72aab2e0ad4c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.721561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298366-3bd4-4326-bead-72aab2e0ad4c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.722025 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298366-3bd4-4326-bead-72aab2e0ad4c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:56:59.722153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:56:59.723192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 56/105] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:56:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:56:59.724594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:59.727181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 50/106] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:56:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:56:59.728797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.729279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.734131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.753278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:59.754784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:59.835280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 51/107] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:56:59.836637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:56:59.852880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b538a-dbd9-4485-89f9-cc2e404bbc57 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:56:59.865471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:59.896575 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:56:59.897669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.898238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.898618 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.900540 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:56:59.902162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395f8b-ec82-40ad-b22c-b6ec6ac767dd None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:56:59.909505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 57/108] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:56:59 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:56:59.909505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:56:59.909505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:56:59.909505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:56:59.930168 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:56:59.931703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:56:59.959181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:56:59.971216 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbb137-7b70-429f-9d64-52d836702f5e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.008497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.009300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.009693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.010124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.011000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 58/109] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:00.018706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] RBAC: Adding query filter params (name=reader) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:00.018706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.018706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.020980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.034695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 52/110] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:56:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.039957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.144120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f107c-f566-4dca-aa86-2abe93db5e19 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.144521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ec723-88a1-4962-98b8-e7084196261a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.155435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.179894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.180784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.180902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.181105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.181353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.181700 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.181995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.182276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.182580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.184123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.190733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 53/111] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.190733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.196252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:00.204118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:00.205079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 59/112] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:00.207000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.218367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.299157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1452c70-9e7e-4e0a-9ff5-d791012899e6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.329765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703119-73a7-4320-b4e0-3f7a42a54278 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.337896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.338753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.339045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.339324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.340598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.342267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521aae0-5c4f-421d-a3c5-25991e7898dd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.344066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 54/113] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.349939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159b380-3d51-4f8b-adb3-7fab56039971 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.350239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159b380-3d51-4f8b-adb3-7fab56039971 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.350521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159b380-3d51-4f8b-adb3-7fab56039971 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.351816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 55/114] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:00.352809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159b380-3d51-4f8b-adb3-7fab56039971 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.371284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.372288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.372591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.372875 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] PATH_INFO: `/v3/users/5f38e4a522084c45a1eea580357fad4e` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.387656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] RBAC: Authorizing `identity:get_user(user_id=5f38e4a522084c45a1eea580357fad4e)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.389267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.395549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 60/115] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/users/5f38e4a522084c45a1eea580357fad4e => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.395549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.424746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.454748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.468206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159b380-3d51-4f8b-adb3-7fab56039971 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.501805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02533b44-cb3c-47ea-851a-8fa6dcad59be None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.503199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.504130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.504425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.504700 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/users/31cd1e327fa840af953d5511aa070317/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.506678 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, user_id=31cd1e327fa840af953d5511aa070317, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.508249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.521651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 56/116] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:00 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/users/31cd1e327fa840af953d5511aa070317/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:00.530893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.550249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.550904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.551198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.551573 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.552299 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:00.552706 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.554272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a5b4b-33ec-43b5-bf17-b334f3fab943 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.569825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 61/117] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.569825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.569825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.569825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.585472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:00.586761 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:00.642641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfa5f1-87dd-4d0b-a331-3227c284d9d4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.668429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 62/118] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:00.677832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.690940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.691644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.691937 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.692220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.692963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.694554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c2239-a6cc-4652-b97f-0f50b70a7031 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.696314 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.729517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 57/119] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:57:00 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:00.731164 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33a91-9b1d-4bea-af60-4e3b9acf545c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.731309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33a91-9b1d-4bea-af60-4e3b9acf545c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.731490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33a91-9b1d-4bea-af60-4e3b9acf545c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.733555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 58/120] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:00.740068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e33a91-9b1d-4bea-af60-4e3b9acf545c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.756025 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:00.806045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e1a0-2835-4400-8707-a495d4b63f47 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.865827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.867087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.867780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.868169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.874818 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e33a91-9b1d-4bea-af60-4e3b9acf545c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:00.920653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:00.922632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:00.923074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:00.923460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:00.924911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.927136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.929435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 59/121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:00.930328 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:00.965131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:00.966700 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e8020-a4f9-4359-b61e-e790c4c9d711 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:00.989718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.039066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.066119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d525da-903e-4800-abba-9544146152c9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.084224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 63/122] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:01.085553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.085850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.086134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.107938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:01.109267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.109500 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:01.110110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.110400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.110696 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.124721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:01.136064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:01.138289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 60/123] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:01.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.184617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 64/124] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:01.185677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.249161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.289729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfbc34-ba1f-4dbc-968f-d2df10c10104 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.306032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302692d9-1a9d-43b1-b5c8-47e27e1cd42f None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.326420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.334824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.336033 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.336463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.336868 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.338242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.340336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.342791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 61/125] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:01.343797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.343921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.344895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.345311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.345693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.347437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.349122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.351120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 65/126] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:01.355542 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.464495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64eb50-a372-471a-8142-2957a83ed478 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.487093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7059-77ae-4e0b-9437-93365c2c479e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.500420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.501259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.501650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.502040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.502948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:01.503363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.504886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.507804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.515401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 62/127] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:01.516411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.529505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.530794 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.531089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.531372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.545952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:01.556832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:01.558551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:01.560465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:01.570708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 66/128] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:01.570708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.585829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.637386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56937b05-2cb5-4b60-a3c6-632141956931 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.674516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.675343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.675731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.676113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/users/296d7ae67cfb462aa7db38b0f4a6b740/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.678321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, user_id=296d7ae67cfb462aa7db38b0f4a6b740, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.680057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.696463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 63/129] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:01 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/users/296d7ae67cfb462aa7db38b0f4a6b740/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:01.697532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.717816 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253788-55b4-4fca-822b-3220c90acbe4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.784302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.785301 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.785749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.786210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.794714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=5f38e4a522084c45a1eea580357fad4e) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:01.795540 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.797252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.803809 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 67/130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/role_assignments?user.id=5f38e4a522084c45a1eea580357fad4e&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=81431837aa97496cbd08a6753846b0fa => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:01.804964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:01.834715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea4c22-a530-4ea0-a92e-7f3b2b51ba07 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:01.853589 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.877456 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:01.878391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:01.878709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:01.879000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:01.881415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:01.882849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:01.892132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 64/131] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:01.892512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:01.899863 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:02.024496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41aeb33-c0e4-4680-9284-72cfa4edaad3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.085964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.086780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.086998 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.087254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.088025 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:02.088341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.089751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.093521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c792b-b16a-49a6-8e3e-32b58cf7dbd2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.112106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 68/132] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:02.117987 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:02.165169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.166070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.166365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.166647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.171693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.173174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.175006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 65/133] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:01 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:02.180671 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:02.263349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:02.273883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cfc3f-255a-4a99-8845-0ea4e8bbeb48 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.277262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:02.309498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bcea3-aff9-4c48-87e2-ae8ef5394101 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.345780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.349295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.350368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.351250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/users/31cd1e327fa840af953d5511aa070317/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.353239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.354139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.354426 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.354722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.356432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.357947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.361083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, user_id=31cd1e327fa840af953d5511aa070317, role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.362644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.367001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 69/134] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:02 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:02.368048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:02.382306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 66/135] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:02 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/users/31cd1e327fa840af953d5511aa070317/roles/b56351c81b57421dad2ef84f35fe7238 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:57:02.504305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c9d9f-8795-45a6-835d-bd36ace1ccee None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.548686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.549673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.549964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.550251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] PATH_INFO: `/v3/projects/2a8828e0e79548de9133afe4ff46cad1` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.551671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] RBAC: Authorizing `identity:get_project(project_id=2a8828e0e79548de9133afe4ff46cad1)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.553194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8eee-c4a5-4706-804f-06402bf5fd95 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.554974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 70/136] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:02 2022] GET /identity/v3/projects/2a8828e0e79548de9133afe4ff46cad1 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:02.561039 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:02.702421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cd1dc-89f7-4ba8-a7e1-c1f78bd55a91 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:02.719751 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:02.745470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:02.746446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:02.746771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:02.747059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] PATH_INFO: `/v3/projects/2a8828e0e79548de9133afe4ff46cad1/users/31cd1e327fa840af953d5511aa070317/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:02.752060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] RBAC: Authorizing `identity:create_grant(project_id=2a8828e0e79548de9133afe4ff46cad1, user_id=31cd1e327fa840af953d5511aa070317, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:02.753566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35822f-34d8-4bce-90b6-afd37130b26d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:02.773116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 67/137] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:02 2022] PUT /identity/v3/projects/2a8828e0e79548de9133afe4ff46cad1/users/31cd1e327fa840af953d5511aa070317/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:03.624844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d855b-4dba-4230-99dd-59cd85621682 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:03.625439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d855b-4dba-4230-99dd-59cd85621682 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:03.625439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d855b-4dba-4230-99dd-59cd85621682 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:03.627218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 71/138] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:03.632947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:03.633381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:03.633568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:03.640820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a76f-4ea7-49b5-ad95-1f7fbf0b2da4 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:03.641102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a76f-4ea7-49b5-ad95-1f7fbf0b2da4 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:03.641389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a76f-4ea7-49b5-ad95-1f7fbf0b2da4 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:03.642808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 72/139] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:03.648198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:03.648490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:03.649124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:03.671117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:03.675985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:03.677194 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:03.679827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:03.740969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:03.809296 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 68/140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:03.820082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 73/141] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:03.843725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:03.849546 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.022655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69b95e-9be9-4a26-9225-8a67f4ddfdc7 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:04.035010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:04.100539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:04.101539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.101838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.102120 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.116833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0d8e-9cd8-4ad6-8c06-8ac05ef06ca3 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:04.135664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:04.153654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:04.154757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:04.155668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 69/142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:04.161640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.224888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:04.226151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.226784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.227635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.235891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:04.237833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:04.239940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 74/143] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:04.245665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.321121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:04.396883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b57c-102e-4b91-8047-8b1e370ac15c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:04.474718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190006-8516-4d43-82e0-0d33a54764c7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:04.516300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:04.517002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.517291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.517575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.518352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:04.518767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:04.520088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:04.530299 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:04.531363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.531986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.532484 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.533572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:04.538982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 70/144] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:04.539894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a75ad-3f58-4d21-a055-c0b03dfae294 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:04.563545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.584488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 75/145] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:04 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:04.634617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:04.691965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9389f-be74-46b2-840f-a46bed904b88 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.693044 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9389f-be74-46b2-840f-a46bed904b88 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.693533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9389f-be74-46b2-840f-a46bed904b88 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.695743 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 76/146] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:04.711918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0b9f6-9dad-4f38-979c-86445baf9e66 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:04.712703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.713092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.713470 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.748780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:04.750013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:04.750448 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:04.750907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:04.751821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:04.752453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:04.753245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:04.754255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:04.756093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 71/147] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:04 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:04.773280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.877377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 77/148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:04.919128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:04.967722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:04.975068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:04.985060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b9302-3180-4035-84bf-7c39e7b24f66 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.077557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.078850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.080127 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.080780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.113594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cd308-750f-4b24-9d27-dfb55ac49a23 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.173007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.174971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605391a1-c190-4969-a27e-b04e23e2090a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.211021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.212012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.212302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.212578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.242529 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-4c1c7024-1a21-4cda-bcb8-3adfe456d2e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:05.257473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:05.258578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:05.259527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:05.262004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 78/149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:05.267791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec74e-ccb5-429b-b5b3-bbb9e1f3ad1d None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.268356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec74e-ccb5-429b-b5b3-bbb9e1f3ad1d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.268833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec74e-ccb5-429b-b5b3-bbb9e1f3ad1d None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.270501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 79/150] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:05.275323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eec74e-ccb5-429b-b5b3-bbb9e1f3ad1d None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.293150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.302229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 72/151] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:05.303438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.303727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.304064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.324578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:05.325825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:05.368204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.390118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eec74e-ccb5-429b-b5b3-bbb9e1f3ad1d None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.407026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 73/152] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:05.408153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.427622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.428741 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.429254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.429742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.430976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:05.431718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.434308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.444712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 80/153] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:05.446043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.536292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386844b-883b-41e4-89ff-eaddfe091070 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.564590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.574618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.575973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.576258 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.576540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.576794 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7418-f6c7-435e-89aa-5d107b7585d4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.577789 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.579466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.581582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 74/154] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:05.582447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.617297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.618610 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.619347 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.619840 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.632658 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:05.641411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:05.642421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:05.643355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:05.645918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 81/155] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:05.646970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.651318 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.699362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba76c5-84b4-4e6e-a853-afca08885716 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.740777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.742184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.742721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.743161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] PATH_INFO: `/v3/users/296d7ae67cfb462aa7db38b0f4a6b740` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.744647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] RBAC: Authorizing `identity:get_user(user_id=296d7ae67cfb462aa7db38b0f4a6b740)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.746352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.748349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 75/156] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/users/296d7ae67cfb462aa7db38b0f4a6b740 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:05.749333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.765448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a0eb-4df0-4e94-8122-b24c4d1b5c3d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.803679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.804616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.805002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.805378 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.806423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:05.806870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.808446 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721b574-24ba-4db5-a5ac-74aa94302078 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.815526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 82/157] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:05.817026 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dbe7-4e75-4aea-bf38-99f93d20440c None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.817429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dbe7-4e75-4aea-bf38-99f93d20440c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.817805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dbe7-4e75-4aea-bf38-99f93d20440c None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.819048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.820608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 83/158] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:05.821760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dbe7-4e75-4aea-bf38-99f93d20440c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:05.867086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aca438-3a51-40b5-8c60-3d8d197b1bdf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:05.909919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:05.910574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.910888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.911162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.911924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:05.912307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:05.913803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812178a-96c1-4d6a-a885-622b0b430265 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:05.925256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:05.926505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 76/159] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:05.928819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:05.928819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:05.928819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:05.949105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:05.951009 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:05.988349 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dbe7-4e75-4aea-bf38-99f93d20440c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.031471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.032287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.032574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.032849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.116169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 77/160] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:06.118775 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.133715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:06.136152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72a5c-fa08-4f47-8b9e-666fd17952a7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:06.196204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:06.252028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e1f4-8d12-428e-9bda-d5c0998afcb5 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.259088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:06.298612 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.299831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.300119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.300399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] PATH_INFO: `/v3/users/5f38e4a522084c45a1eea580357fad4e` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.301536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 84/161] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:06.301662 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] RBAC: Authorizing `identity:get_user(user_id=5f38e4a522084c45a1eea580357fad4e)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:06.302962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d449fd-39f1-4acc-b162-f51fa88fb6d4 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.303183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e6f89-854c-4746-9026-0ba65d3ac67d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:06.303284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d449fd-39f1-4acc-b162-f51fa88fb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.303535 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d449fd-39f1-4acc-b162-f51fa88fb6d4 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.304812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 85/162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:06.305047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 78/163] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/users/5f38e4a522084c45a1eea580357fad4e => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:06.305518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d449fd-39f1-4acc-b162-f51fa88fb6d4 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.311094 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.311388 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.311673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.333469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:06.335241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:06.425375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 79/164] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:06.426257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.447859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d449fd-39f1-4acc-b162-f51fa88fb6d4 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.518766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.520890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.522366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.522850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.536543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:06.549013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:06.561036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:06.562286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:06.563433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:06.566440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 86/165] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:06.567609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.614957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c2ec-e1d3-4312-b4bb-815c0a2d24e4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.650430 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:06.656485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.657627 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.658662 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.659273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.663352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:06.665095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:06.669767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 80/166] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:06.672404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.794558 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc499-418b-48f0-acbb-b3d48bf195c3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.802752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3f9c-af02-4394-8b04-81b09422761f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:06.816739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:06.832427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.833478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.833936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.834378 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.853021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:06.854423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:06.854944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:06.855742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:06.857226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:06.859086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:06.861055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 87/167] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:06.862115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:06.862301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:06.871687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:06.872799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:06.873710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:06.877729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 81/168] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:06.879468 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.027181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:07.035218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b36a9-a23e-45e9-938c-d540e56261d5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.062787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e121ac3-6a67-49aa-8cfd-7fe790554ea0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.073841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.074720 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.075271 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.075682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.076545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:07.077519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.079040 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.088758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 88/169] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:07.090004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.137941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.138625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.138936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.139219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.140066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=296d7ae67cfb462aa7db38b0f4a6b740) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:07.140382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.141864 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.157845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 82/170] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:06 2022] GET /identity/v3/role_assignments?user.id=296d7ae67cfb462aa7db38b0f4a6b740&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:07.158697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.263898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:07.298130 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b1406-9d61-4266-8fc8-62da3b278b62 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.379289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.380146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.380429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.380703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/users/5f38e4a522084c45a1eea580357fad4e/roles/81431837aa97496cbd08a6753846b0fa` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.383423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0635f8-08d5-4940-8185-03e41f808060 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.384452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, user_id=5f38e4a522084c45a1eea580357fad4e, role_id=81431837aa97496cbd08a6753846b0fa)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.386206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.421869 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 89/171] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:07 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/users/5f38e4a522084c45a1eea580357fad4e/roles/81431837aa97496cbd08a6753846b0fa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:07.422746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.433279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.434101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.434386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.434770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.435552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:07.436978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.438540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.449654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 83/172] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:07.457794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.483088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:07.681024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2010f-6299-4ef8-8310-3c718cd8b064 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.690848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107efbf-8f1c-403e-8a10-d801184e6059 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.691067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:07.735522 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.736430 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.736713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.736994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.740855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.741761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.742048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.742324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] PATH_INFO: `/v3/users/31cd1e327fa840af953d5511aa070317` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.743452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.743767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] RBAC: Authorizing `identity:get_user(user_id=31cd1e327fa840af953d5511aa070317)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.744951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.745218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:07.746860 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 90/173] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:07 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:07.747442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 84/174] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:07 2022] GET /identity/v3/users/31cd1e327fa840af953d5511aa070317 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:07.758084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.768686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:07.847962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:07.865081 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ab88-e540-4ec1-8060-e6669096c166 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.901964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:07.902993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:07.903531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:07.904033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:07.948565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721403a-adf8-4cb8-b046-d85e2d2b9abb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:07.976059 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:07.977931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.006342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:08.007100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.007479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.007764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.062635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:08.079599 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 91/175] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:08.082420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:08.085672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:08.130638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:08.132280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.190629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd4d7-11cf-46a0-b357-d8fc2ee243f4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:08.225691 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:08.226630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.226941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.227561 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] PATH_INFO: `/v3/projects/2a8828e0e79548de9133afe4ff46cad1` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.228823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] RBAC: Authorizing `identity:get_project(project_id=2a8828e0e79548de9133afe4ff46cad1)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:08.230429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.232544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 92/176] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:08 2022] GET /identity/v3/projects/2a8828e0e79548de9133afe4ff46cad1 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:08.238068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:08.296206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:08.321936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 85/177] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:57:08.328004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:08.343017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e8174-e64a-4a47-bc58-3ff8e187a4bb None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:08.379311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:08.379985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.380276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.380541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.381384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=2a8828e0e79548de9133afe4ff46cad1, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:08.381693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:08.383212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.389882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 93/178] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:08 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=2a8828e0e79548de9133afe4ff46cad1&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:08.473946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:08.514620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d81d75-1a92-45b5-ae43-061e7754c9b6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:08.559791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:08.560683 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.560966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.561243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.562463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:08.563962 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a57f4-497c-44c4-a65f-aad2d4aa6ab9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.565893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 86/179] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:08 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:08.572575 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:08.710237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab8389-d4f5-4e21-b6c8-da2de8c4c2d8 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.710604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab8389-d4f5-4e21-b6c8-da2de8c4c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.710834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab8389-d4f5-4e21-b6c8-da2de8c4c2d8 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.712896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 87/180] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:08.718506 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.718857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.719438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.745238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a529ec-7a1d-4221-8509-d26cd595734f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:08.747704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:08.748914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:08.775324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:08.806290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:08.807017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:08.807303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:08.807581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:08.808439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=31cd1e327fa840af953d5511aa070317) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:08.809571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:08.811769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:08.826225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 94/181] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:08 2022] GET /identity/v3/role_assignments?user.id=31cd1e327fa840af953d5511aa070317&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:08.865799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 88/182] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:08.908303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.037652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90a2c4-79d5-4d1d-baac-deba7278f5b1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.088183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.089035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.089321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.089603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.107876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d6ece317-7c91-4db3-8170-274a9a19b74b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:09.115953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:09.117027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:09.117923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 95/183] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:09.123640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.176234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d7a7-4b44-4903-8c19-27a03600a120 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.176609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d7a7-4b44-4903-8c19-27a03600a120 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.176809 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d7a7-4b44-4903-8c19-27a03600a120 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.178343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 96/184] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:09.183324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ef6d-b0a7-4c56-b18c-c251e29d15c0 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.183616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ef6d-b0a7-4c56-b18c-c251e29d15c0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.183898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ef6d-b0a7-4c56-b18c-c251e29d15c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.203940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3b67ef6d-b0a7-4c56-b18c-c251e29d15c0 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:09.205348 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3b67ef6d-b0a7-4c56-b18c-c251e29d15c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:09.205958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.244276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f201f-d609-40e2-a03a-dd7086ff9a1f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.268697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.289272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.289880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.290162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.290432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.291220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:09.291525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.292922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74750-0f1c-46c4-b7ab-a25c4733845e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.297153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 97/185] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:09.298522 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155916-8128-4c9f-aa82-d268e3fd6bef None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.303168 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155916-8128-4c9f-aa82-d268e3fd6bef None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.303692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155916-8128-4c9f-aa82-d268e3fd6bef None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.305290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 98/187] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:09.306997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 89/187] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:09.309255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97155916-8128-4c9f-aa82-d268e3fd6bef None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.312535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.312831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.313122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.331910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:09.333115 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:09.405202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 90/188] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:09.406968 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.415845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97155916-8128-4c9f-aa82-d268e3fd6bef None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.452694 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.453583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.453864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.454135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.467756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.469985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.471954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 99/189] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:09.472553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.493397 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.504904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.538389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109e79c-a6a0-4a10-98e7-b9842e005c65 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.576622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.577552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.577841 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.578130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.582054 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ec52-2b7e-4cf2-a187-6ba99d8029ab None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.588417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:09.596642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:09.597902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 91/190] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:09.599653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.620885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.621701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.622024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.622303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.623542 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.625015 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.631045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 100/191] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:09.631045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.715615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b87663-afcc-4dc6-b40d-511f8c7a8910 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.733134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.737481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5b85a-db5c-4dc0-8388-afd99342f252 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.741918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.754616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.755510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.755800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.756171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.773904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.774673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.774991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.775266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.776020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:09.776324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.777709 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.788192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 101/192] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:09.789247 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.837738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.839350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.898486 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e888-68d7-4b56-a2b4-430f5e916c2e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:09.935233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:09.936868 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:09.937309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:09.937738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:09.938634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:09.939790 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 92/193] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:09.940456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:09.943729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.963189 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 102/194] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:09 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:09.963941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:09.986949 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:09.996386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:10.088591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce4446-70fb-4019-a987-8816537b9814 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.110194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891d6a-b080-4d3e-9ce4-f060613cd483 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.149041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:10.151013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.151470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.151903 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.153454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:10.155364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:10.156600 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:10.157545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 93/195] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:10.157931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.158228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.158509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.159969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:10.161451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:10.163377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:10.168674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 103/196] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:09 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:10.170046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:10.280660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:10.289669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:10.303854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e8a60-f346-471b-8293-2db6701bb278 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.304808 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5add0bc-c2ea-455a-9f7a-6b14b953e5d0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.357197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:10.358053 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.358466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.358928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.360164 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=27c22a152db04601a41385ea094ea33f) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:10.360682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:10.362161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:10.362593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fafbe-dc7e-4c51-a3e9-89b9be5380ab None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:10.363001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.363353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.363698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.370342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 104/197] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:10 2022] GET /identity/v3/role_assignments?user.id=27c22a152db04601a41385ea094ea33f&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:10.451725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:10.453591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:10.547561 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c0e2-9967-40f3-9bea-f2326365d779 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.547847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c0e2-9967-40f3-9bea-f2326365d779 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.548132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c0e2-9967-40f3-9bea-f2326365d779 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.549552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 105/198] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:10.562098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.562768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.563296 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.575619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:10.580840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 94/199] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:10.587846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:10.590556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:10.592174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:10.726707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 106/200] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:10.746917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:10.774552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338d2e7-1a4c-49ab-a2f3-502d6ca96834 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.835059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:10.835957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:10.836237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:10.836515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:10.837865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:10.839389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:10.841168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 95/201] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:10 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:10.848308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:10.893577 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:10.933316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13969f-32a8-42c1-86a7-c3395d6c167b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:10.965318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:11.005048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:11.005867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:11.006146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:11.006415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:11.030305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1990e-7e0e-4725-b29b-231d5dced24b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:11.032617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:11.046722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:11.047771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:11.048679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 107/202] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:11.055896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:11.070358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:11.071402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:11.071925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:11.072410 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:11.073461 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=27c22a152db04601a41385ea094ea33f) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:11.073985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:11.075814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:11.082303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 96/203] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:10 2022] GET /identity/v3/role_assignments?user.id=27c22a152db04601a41385ea094ea33f&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:11.230797 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174acfa-405d-40f9-beeb-ce0c1e77bc23 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:11.279952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:11.280715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:11.281007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:11.281289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:11.282136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:11.282449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:11.283909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:11.292434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:11.298803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 108/204] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:11.305922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:11.411079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781d9fd-d293-4484-8edf-75e016a36bfd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:11.439080 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:11.455049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:11.456462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:11.457013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:11.457523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] PATH_INFO: `/v3/users/5f38e4a522084c45a1eea580357fad4e` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:11.459083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] RBAC: Authorizing `identity:get_user(user_id=5f38e4a522084c45a1eea580357fad4e)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:11.460800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:11.462730 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 97/205] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:11 2022] GET /identity/v3/users/5f38e4a522084c45a1eea580357fad4e => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:11.468607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:11.619560 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d078933-433e-4501-b9b5-e0ac680e79f0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:11.667321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:11.667990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:11.668280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:11.668554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:11.762190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:11.767853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:11.769738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:11.909144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 109/206] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:11.914987 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:12.048995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa5a0e-e3ef-4a25-a6c6-805a33d45212 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:12.092847 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:12.093741 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:12.094022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:12.094301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:12.095555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:12.097020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867506-4269-4ca4-b05a-2b8d225026b8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:12.099000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 98/207] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:11 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:12.105653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:12.240099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:12.243368 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665b341-2c54-4834-93a7-b74cd67bfc34 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:12.295020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:12.295697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:12.295986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:12.296269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:12.297352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, scope.project.id=87eac1825a58408795d196c24623a9c8, user.id=5f38e4a522084c45a1eea580357fad4e) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:12.297672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:12.299195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc411d-60e0-44c8-9286-1c6e513ee0ca None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:12.310770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 110/208] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:12 2022] GET /identity/v3/role_assignments?user.id=5f38e4a522084c45a1eea580357fad4e&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=81431837aa97496cbd08a6753846b0fa => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:12.833108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dffd3-8224-4fef-973c-0dfcbd352b9b None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:12.833680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dffd3-8224-4fef-973c-0dfcbd352b9b None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:12.833680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dffd3-8224-4fef-973c-0dfcbd352b9b None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:12.835427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 99/209] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:12.841033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb47e4-5e3c-447d-a5fe-4d16aa7fd74f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:12.841320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb47e4-5e3c-447d-a5fe-4d16aa7fd74f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:12.841598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb47e4-5e3c-447d-a5fe-4d16aa7fd74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:12.860494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-2deb47e4-5e3c-447d-a5fe-4d16aa7fd74f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:12.861694 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-2deb47e4-5e3c-447d-a5fe-4d16aa7fd74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:12.942038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 111/210] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:12.967425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dffd3-8224-4fef-973c-0dfcbd352b9b None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.007568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43974f-9038-450c-9345-5df636fc92dc None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.008020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43974f-9038-450c-9345-5df636fc92dc None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.008312 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43974f-9038-450c-9345-5df636fc92dc None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.010060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 112/211] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:13.016365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.017099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.017637 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.042718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:13.046774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:13.054940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.098031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dffd3-8224-4fef-973c-0dfcbd352b9b None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.122164 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 113/212] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:13.142502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.143580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.144047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.144511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.145879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.148454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.149001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.151365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 100/213] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:13.157198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.175680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.258445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d952495-fedf-4212-a44f-c345953e79f7 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.264905 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f2ef-896c-402f-8a5f-749f7b7627e0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.293832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.295952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.296821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.297089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.297373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.302652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.303720 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.304273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.304555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.305283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.306815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70dfb5-a935-4aa5-a0f0-6cdf749e7fa9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.308611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-197e9709-0b31-49dd-a626-96e1e99ed1e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:13.318150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:13.319383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:13.320320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 114/214] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:13.324220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ef91-ff86-42fe-9c10-0e4e210987e7 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.324991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ef91-ff86-42fe-9c10-0e4e210987e7 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.325559 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ef91-ff86-42fe-9c10-0e4e210987e7 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.327751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 115/215] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:13.328723 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ef91-ff86-42fe-9c10-0e4e210987e7 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.346724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 101/216] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:13 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:13.346724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.346724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.346724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.356745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:13.358120 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:13.440681 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 102/217] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:13.466171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.469376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.492755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ef91-ff86-42fe-9c10-0e4e210987e7 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.545544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.546310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.546662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.547077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.548486 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:13.548881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.550645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.562578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 116/218] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:13.569023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.591021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3049-e7db-4011-928e-c93b8db8382c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.614919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.655441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.656266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.656562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.656832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.671008 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:13.680261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:13.681330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:13.685219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 103/219] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:13.688980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.725087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cccbba-d465-43e3-9e3e-507c3f28a02d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.771850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.773043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.774197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.774487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.775845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.777332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.779375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 117/220] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:13.784757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.801569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.808057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7c21-71b5-49f3-b2ea-f9b72024579a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.850611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.851340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.851746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.852027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.852965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:13.853274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.854735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807bb4a-f7dd-4df6-872d-7a14d7a991e8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.864626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 104/221] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:13.865739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551e45-4bd9-488b-8524-c5aaceae2bcf None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.866032 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551e45-4bd9-488b-8524-c5aaceae2bcf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.866310 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551e45-4bd9-488b-8524-c5aaceae2bcf None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.872705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 105/222] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:13.873659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.873936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.874220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.896284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:13.898152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:13.900089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ea68-e0e2-499b-9000-086a2949bdb7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:13.933583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:13.941484 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:13.942369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:13.942653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:13.942953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:13.944160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:13.945625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:13.947390 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 118/223] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:13.950731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:13.979244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 106/224] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:13.980140 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.053804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:14.081228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a73f-78b6-401b-89db-894edf98e2d3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.118283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.119588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.120116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.120602 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] PATH_INFO: `/v3/users/9cea54d87cd442e9a9c692d1ad4c896d` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.136802 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] RBAC: Authorizing `identity:get_user(user_id=9cea54d87cd442e9a9c692d1ad4c896d)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:14.137518 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f2488-9b48-471b-8414-ce80fe443536 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.139312 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:14.141404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 119/225] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:13 2022] GET /identity/v3/users/9cea54d87cd442e9a9c692d1ad4c896d => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:14.146972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.180909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.182090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.182377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.182657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/27c22a152db04601a41385ea094ea33f/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.184834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, user_id=27c22a152db04601a41385ea094ea33f, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:14.187461 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:14.205849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 107/226] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:13 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/27c22a152db04601a41385ea094ea33f/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:14.207174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.274055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:14.313831 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf2f18-3e54-441a-a645-c43783c0b425 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.380295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.381145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.381429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.381712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.384430 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb43e3-20fc-4056-b439-23a590c44449 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.409380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:14.417488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:14.420215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:14.421223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:14.422102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 120/227] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:14.430305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.469131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.469821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.470110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.470390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.562616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:14.564863 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:14.575351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2519e12-bff9-48f5-8a3d-29e483ab0e36 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.623384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:14.646518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.647234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.647521 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.647798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.648566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:14.648876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:14.650271 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:14.670435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 121/228] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:14.675984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.758760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 108/229] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:14.765797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.794143 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:14.839663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378dfcb-96ec-455e-81d3-15a2b7e4211e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.880160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:14.881397 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:14.881896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:14.882336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:14.884528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:14.886363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:14.888645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 122/230] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:14.893710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:14.961318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c601e-9443-44c4-a124-ba453abff904 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:14.992068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:15.002135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:15.003389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:15.003922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:15.004412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:15.005925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:15.007794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:15.010035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 109/231] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:15.015757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:15.100786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb2fee-0102-424c-8f1b-ac50465434e5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:15.122801 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f347d-e720-491e-8ac0-9aa7ef0f8f1e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:15.158551 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:15.159619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:15.160245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:15.160722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:15.161936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=9cea54d87cd442e9a9c692d1ad4c896d) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:15.162457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:15.164264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:15.170850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 110/232] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:15 2022] GET /identity/v3/role_assignments?user.id=9cea54d87cd442e9a9c692d1ad4c896d&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:15.179108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:15.187150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:15.188622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:15.188908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:15.189234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:15.195740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:15.197269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc961ab-b642-49ed-8bb2-d8489698bb16 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:15.199649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 123/233] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:14 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:15.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:15.271570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:15.325029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaac898-df91-4f92-accd-76aaedb6d265 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:15.364225 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:15.365582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:15.366096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:15.366603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/27c22a152db04601a41385ea094ea33f/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:15.369279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, user_id=27c22a152db04601a41385ea094ea33f, role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:15.371104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a94e6-909f-45a4-8c9a-a4073a7c0b33 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:15.397900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 111/234] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:15 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/27c22a152db04601a41385ea094ea33f/roles/b56351c81b57421dad2ef84f35fe7238 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:16.087872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5089f-7876-475b-bdd5-615d8b40d459 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.088097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5089f-7876-475b-bdd5-615d8b40d459 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.088377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5089f-7876-475b-bdd5-615d8b40d459 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.089808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 124/235] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:16.095909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7fa5-30a4-4a4a-a5f9-a3d647ad6bab None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.096874 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7fa5-30a4-4a4a-a5f9-a3d647ad6bab None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.097364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d7fa5-30a4-4a4a-a5f9-a3d647ad6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.120022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-9f5d7fa5-30a4-4a4a-a5f9-a3d647ad6bab None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:16.121643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-9f5d7fa5-30a4-4a4a-a5f9-a3d647ad6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:16.195760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 112/236] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:16.219297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5089f-7876-475b-bdd5-615d8b40d459 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:16.280305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a822c-67d3-4774-b55c-69f0bd38f3fd None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.280955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a822c-67d3-4774-b55c-69f0bd38f3fd None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.281465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a822c-67d3-4774-b55c-69f0bd38f3fd None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.283366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 113/237] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:16.288786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.289347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.289834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.327831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:16.329043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:16.356782 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5089f-7876-475b-bdd5-615d8b40d459 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:16.393139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:16.394345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.394917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.395419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.407485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:16.415952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:16.416936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:16.417916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:16.420789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 125/238] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:16.427024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:16.431448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:16.475481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 114/239] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:16.510944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:16.536112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:16.585616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f105-5c1c-4c51-92aa-975fc625a1ad None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:16.627736 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:16.628341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.628631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.628912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.634704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:16.634704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:16.634704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:16.646802 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 126/240] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:16.648268 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:16.764779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29143f7f-b17e-4775-8ab7-73935fa65360 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:16.780824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb492b0-0f7f-4f02-bbf7-6f9f5a677feb None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:16.788305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:16.809227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:16.811725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.812661 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.813668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] PATH_INFO: `/v3/users/2fa839ea5d734a0fb9984987603dc728` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.845095 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] RBAC: Authorizing `identity:get_user(user_id=2fa839ea5d734a0fb9984987603dc728)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:16.849432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:16.853079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 127/241] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:16 2022] GET /identity/v3/users/2fa839ea5d734a0fb9984987603dc728 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:16.859916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:16.860706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:16.862060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:16.863905 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:16.864345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:16.866638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:16.871943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:16.875171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 115/242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:16.880358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.000186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.009095 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0f2a-fdfe-48c9-8fbe-76f3dff89b87 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.048922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.049891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.050333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.050804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.109354 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.134811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:17.136553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:17.149580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9243-126d-4469-a3bd-218de78dfb1d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.186138 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.186851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.187134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.187408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.188194 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:17.189814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149cef-73a0-4064-b19a-e87a00fbfbd1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:17.218921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 116/243] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:16 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:17.218921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eca17-91d4-4745-9aa6-fbb997539b02 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.218921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eca17-91d4-4745-9aa6-fbb997539b02 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.218921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eca17-91d4-4745-9aa6-fbb997539b02 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.218921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 117/244] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:17.222999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.223121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.223325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.242197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:17.243750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:17.291493 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 128/245] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:17.297781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.334495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 118/246] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:17.414382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.440956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.456884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.475558 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c05178-dbd2-433d-b781-16166916b141 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.540795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8a623-c897-47e5-8e79-0c581ef53272 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.543110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.543922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.544331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.544611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.545833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:17.547348 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:17.549394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 129/247] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:17.555238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.582341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.583673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.584159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.584671 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.598110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:17.608004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:17.609036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:17.609944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:17.612212 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 119/248] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:17.618134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.717725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b604fc-325e-48cd-8b50-baee16680dc1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.737501 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.749367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edebed7-1876-4b69-8ac5-639e5080fe1a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:17.762936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.764943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.765583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.766057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.767715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=2fa839ea5d734a0fb9984987603dc728) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:17.768249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:17.770022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ea012-e94f-4113-aeef-b7d19715ea05 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:17.782714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 130/249] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/role_assignments?user.id=2fa839ea5d734a0fb9984987603dc728&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=81431837aa97496cbd08a6753846b0fa => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:17.782714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f3d9-7b10-459f-9ce5-8b2869bd2a82 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.782714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f3d9-7b10-459f-9ce5-8b2869bd2a82 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.782714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093f3d9-7b10-459f-9ce5-8b2869bd2a82 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.782714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 131/250] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:17.789777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.790083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.790340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.795625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:17.796338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:17.796624 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:17.796901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:17.797672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:17.797985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:17.799484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:17.809454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 120/251] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:17.816417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.817942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:17.819229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:17.828873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:17.923076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 132/252] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:17.949126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:17.961270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf147854-355c-4f3a-9b1b-b2ba2b666618 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.005684 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.007629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.007921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.008205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.009559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:18.011121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:18.013372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 121/253] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:18.022581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.060074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.103284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e38da-c7cf-461d-b8cf-406fec1e7585 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.144289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.145629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.146136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.146632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.158185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.162570 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-cb7d5a7c-a308-41d4-b406-5735719d5c4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:18.174049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:18.175197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:18.176090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 133/254] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:18.177885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0912c3-d2be-4caf-8e1c-0235b945fbaa None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.178300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0912c3-d2be-4caf-8e1c-0235b945fbaa None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.178650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0912c3-d2be-4caf-8e1c-0235b945fbaa None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.184138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 134/255] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:18.185120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0912c3-d2be-4caf-8e1c-0235b945fbaa None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.197069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832898b-9629-4524-8bde-ef07b46ca9c3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.233569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.234041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.234377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.234664 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.303759 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0912c3-d2be-4caf-8e1c-0235b945fbaa None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.306053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:18.307853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:18.332720 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.355823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.357003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.358125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.359019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.360410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:18.361953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:18.365877 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271fe73-0d70-4982-89c5-00c829c92ff4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:18.384233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 135/256] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:18.386021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.391067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.391960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.412236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:18.413866 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:18.476246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.488988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 136/257] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:18.490335 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.526576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 122/258] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:18.527485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.645327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c8aa-7c44-4124-b9eb-74afc504c559 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.706520 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.707836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.709331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.709856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] PATH_INFO: `/v3/users/9cea54d87cd442e9a9c692d1ad4c896d` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.711497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] RBAC: Authorizing `identity:get_user(user_id=9cea54d87cd442e9a9c692d1ad4c896d)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:18.714386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:18.719514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 137/259] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/users/9cea54d87cd442e9a9c692d1ad4c896d => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:18.725663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.735249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e1512-7283-4dc8-b0d2-9a3f0c6d6d1a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.786486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.811132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:18.823814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.824652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.824969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.825251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.846721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:18.855334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:18.856503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 123/260] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:18.857392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:18.881746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361c5c1-c01f-428b-a144-7f3a285ec50f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:18.941090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:18.942572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:18.942888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:18.943171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:18.944554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:18.946670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:18.951623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 138/261] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:18.952524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:19.049077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8772-da4e-4c4c-bad6-524e2e4fa196 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.119401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.120297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.120587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.120867 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.122151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.123666 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.125479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 124/262] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:19.130939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:19.131099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaefaf-e80b-4aed-811d-0a08c496d269 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.171202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:19.176449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.177154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.177433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.177701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.178471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:19.181403 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.184310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.208983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 139/263] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:19.209832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:19.225685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:19.285037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b28e9-7c32-435b-84d7-59753ef38943 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.332293 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.332986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.333273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.333553 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.334469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=27c22a152db04601a41385ea094ea33f) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:19.334875 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.336380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.344152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 125/264] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:19 2022] GET /identity/v3/role_assignments?user.id=27c22a152db04601a41385ea094ea33f&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:19.344996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:19.464716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa665b-db9f-4674-89de-dd05d4dd4ac9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.544126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.545186 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.545635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.545923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/9cea54d87cd442e9a9c692d1ad4c896d/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.553467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, user_id=9cea54d87cd442e9a9c692d1ad4c896d, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.555006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.562036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f44b6d-1963-49bb-a9bd-b4f24bb32e5e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.589295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 140/265] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:19 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/9cea54d87cd442e9a9c692d1ad4c896d/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:19.597686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:19.636358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.637346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.637629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.637908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] PATH_INFO: `/v3/users/27c22a152db04601a41385ea094ea33f` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.642126 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] RBAC: Authorizing `identity:get_user(user_id=27c22a152db04601a41385ea094ea33f)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.643795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.645758 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 126/266] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:19 2022] GET /identity/v3/users/27c22a152db04601a41385ea094ea33f => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:19.651656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:19.713004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:19.778383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7de9d-83d4-4290-953a-ab2193ff5ded None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:19.820092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:19.820782 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:19.821061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:19.821339 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:19.916580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:19.918074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:19.972911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:20.029692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 141/267] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:20.035263 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:20.174994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d65008-76f9-4780-bd05-1b3f06a4014d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:20.219719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:20.220600 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.220884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.221158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.225561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:20.227363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d719-8ab7-4cf9-8677-c18712ff9993 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:20.229098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 127/268] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:20 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:20.235142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:20.378175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e753-52ef-4244-82d2-22f49556e0c0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:20.433141 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:20.433845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.434180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.434463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.435365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=27c22a152db04601a41385ea094ea33f) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:20.435689 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:20.437216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c4588-4472-499d-bd99-c5ab302f62b7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:20.448248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 142/269] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:20 2022] GET /identity/v3/role_assignments?user.id=27c22a152db04601a41385ea094ea33f&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:20.638990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792edf9b-bb48-49bd-b72a-6c0694106400 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.639375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792edf9b-bb48-49bd-b72a-6c0694106400 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.639583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792edf9b-bb48-49bd-b72a-6c0694106400 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.641301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 128/270] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:20.646824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a523b-c60f-4c41-ab32-e562d2f19285 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.647337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a523b-c60f-4c41-ab32-e562d2f19285 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.647416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a523b-c60f-4c41-ab32-e562d2f19285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.671984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-8d4a523b-c60f-4c41-ab32-e562d2f19285 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:20.673226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-8d4a523b-c60f-4c41-ab32-e562d2f19285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:20.684958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:20.717739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707c46-fec8-49b5-b2a0-140992546b73 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.718052 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707c46-fec8-49b5-b2a0-140992546b73 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.718300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707c46-fec8-49b5-b2a0-140992546b73 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.719765 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 129/271] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:20.734518 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.734836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.735333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.758048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:20.760167 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:20.762438 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 143/272] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:20.780016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7512-f12a-41cd-97a5-5a6f71544057 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.780327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7512-f12a-41cd-97a5-5a6f71544057 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.780597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b7512-f12a-41cd-97a5-5a6f71544057 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.782260 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 144/273] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:20.787527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:20.788001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:20.788414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:20.808280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:20.809514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:20.827540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:20.854471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 130/274] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:20.855306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:20.897342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 145/275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:20.899666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:20.988799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7299-6372-421f-b8a8-724950272ca1 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:20.990113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.020411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76454f-b871-457e-a5e7-b8633f399d80 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.026048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.026897 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.027183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.027460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.037680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:21.045421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:21.046557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:21.047591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 131/276] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:21.051825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.061671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.062888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.063321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.063742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.065134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.066983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.073665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 146/277] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.074964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.094842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.156135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05747ed-3aa1-4a91-a696-c3457378906a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.184761 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef3b5-1507-46fb-8ed4-0ca10fa93f08 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.189673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.190488 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.190793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.191057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.202021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:21.210513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:21.211618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 132/278] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:21.213141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.232598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.233601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.234069 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.234525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.235530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:21.236047 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.237594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.246829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 147/279] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.247878 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.252110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.328449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.332128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747091a5-8175-4681-b7be-fbac395f12d7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.354852 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51042e-65e3-4292-9414-942270afa576 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.368314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.369105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.369393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.369672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.370389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.371943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.391517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.392274 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.392613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.392914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.393645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:21.393953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.394212 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 133/280] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:21 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:21.395149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.395800 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.410803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 148/281] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.416589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.499205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.512876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae182f0-96f6-4921-bec0-91e896fbe33e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.547947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f4639-bf54-4db0-ba9e-c623fdfed920 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.551484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.552419 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.552705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.552987 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] PATH_INFO: `/v3/users/28428fd933a94c4c819db372d3439630` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.570570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] RBAC: Authorizing `identity:get_user(user_id=28428fd933a94c4c819db372d3439630)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.572149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.573969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 134/282] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/users/28428fd933a94c4c819db372d3439630 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.580276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.593227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.594839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.595166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.595453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] PATH_INFO: `/v3/users/2fa839ea5d734a0fb9984987603dc728` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.597247 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] RBAC: Authorizing `identity:get_user(user_id=2fa839ea5d734a0fb9984987603dc728)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.598795 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.601067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 149/283] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/users/2fa839ea5d734a0fb9984987603dc728 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.602754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.608134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.709598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703b8-1ee6-4aa0-bd34-6f1dad891b0e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.736754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b9c4-10f0-4a72-b152-0c00d2dffb58 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.754561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.755567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.755862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.756141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.757161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, user.id=28428fd933a94c4c819db372d3439630, scope.system=all) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:21.757495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.759357 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.770805 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 135/284] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/role_assignments?user.id=28428fd933a94c4c819db372d3439630&scope.system=all&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:21.784960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.785881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.786167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.786442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.789323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.790964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff415-1649-4d2b-900a-43ea4cc2b432 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:21.793141 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 150/285] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:21 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:21.799154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:21.901680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:21.933273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0960a-1e96-41c0-a664-a7c4d857e532 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:21.992548 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:21.993398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:21.993708 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:21.993991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/2fa839ea5d734a0fb9984987603dc728/roles/81431837aa97496cbd08a6753846b0fa` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:21.996001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, user_id=2fa839ea5d734a0fb9984987603dc728, role_id=81431837aa97496cbd08a6753846b0fa)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:21.997543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a3f9-99dc-4fdd-a69a-cf43e6ee68a7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:22.014600 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 136/286] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:57:21 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/users/2fa839ea5d734a0fb9984987603dc728/roles/81431837aa97496cbd08a6753846b0fa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:22.264056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4436-352b-4e52-9b6e-4f46f32e0eab None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:22.264245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4436-352b-4e52-9b6e-4f46f32e0eab None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:22.264521 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a4436-352b-4e52-9b6e-4f46f32e0eab None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:22.265931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 151/287] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:22.274052 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:22.274344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:22.274622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:22.299733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:22.300982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:22.372262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 137/288] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:22.403950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a4436-352b-4e52-9b6e-4f46f32e0eab None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:22.407058 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:22.541035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a4436-352b-4e52-9b6e-4f46f32e0eab None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:22.584343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:22.585191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:22.585478 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:22.585757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:22.604043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:22.612179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:22.613182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:22.614114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 152/289] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:22.620255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:22.733839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:22.774478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f2a0-b8a4-422b-8a4a-5c47694b50c0 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:22.826669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:22.827734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:22.828184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:22.828616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:22.829542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:22.830005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:22.831797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:22.846399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 138/290] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:22.852480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:22.951666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:23.006828 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787264ba-3a23-4abb-9e9e-f652e39756c0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:23.054138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:23.055069 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:23.055353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:23.055639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] PATH_INFO: `/v3/users/9cea54d87cd442e9a9c692d1ad4c896d` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:23.056858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] RBAC: Authorizing `identity:get_user(user_id=9cea54d87cd442e9a9c692d1ad4c896d)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:23.058330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:23.060347 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 153/291] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:22 2022] GET /identity/v3/users/9cea54d87cd442e9a9c692d1ad4c896d => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:23.065591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:23.232910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345fe4-12a8-4bb4-8789-07ea50d04b93 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:23.281075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:23.288049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:23.288716 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:23.289005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:23.289276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:23.386193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:23.387767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:23.505610 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 139/292] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:23.511544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:23.676821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b7cb8-32f1-49d4-b7a3-a910bb0f05b2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:23.713884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:23.720871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:23.721820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:23.722112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:23.722391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:23.727746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:23.729213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247e3a-b03c-4c1a-add8-f8ab4e8226a6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:23.731269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 154/293] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:23 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:23.737045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:23.803568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:23.907334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef53b5b-4760-4a2f-8db0-719954e4e1c2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:23.945339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:23.946021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:23.946310 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:23.946590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:23.947465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=9cea54d87cd442e9a9c692d1ad4c896d) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:23.947783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:23.949252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01238ae2-577d-4528-a199-318fe127dba0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:23.956123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 140/294] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:23 2022] GET /identity/v3/role_assignments?user.id=9cea54d87cd442e9a9c692d1ad4c896d&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:24.434722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3dd4-2c01-4c51-a7c2-556054f0d329 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.435774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3dd4-2c01-4c51-a7c2-556054f0d329 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.436297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac3dd4-2c01-4c51-a7c2-556054f0d329 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.437998 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 155/295] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:24.444289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.445206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.445487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.469330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:24.470559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:24.521344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4c0c-1c97-45c3-9214-e1e3d13ee6da None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.521710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4c0c-1c97-45c3-9214-e1e3d13ee6da None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.521920 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc4c0c-1c97-45c3-9214-e1e3d13ee6da None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.523675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 156/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:24.529992 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faea5f-b830-40a2-9e80-c513c8bbbf8d None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.530392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faea5f-b830-40a2-9e80-c513c8bbbf8d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.530590 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faea5f-b830-40a2-9e80-c513c8bbbf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.553643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-d6faea5f-b830-40a2-9e80-c513c8bbbf8d None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:24.555588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-d6faea5f-b830-40a2-9e80-c513c8bbbf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:24.565242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 141/297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:24.587217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:24.618461 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:24.638284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 157/298] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:24.661809 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072191-673f-4e9d-a760-a66b375e5c5a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.662101 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072191-673f-4e9d-a760-a66b375e5c5a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.662596 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072191-673f-4e9d-a760-a66b375e5c5a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.664072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 158/299] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:24.664949 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19072191-673f-4e9d-a760-a66b375e5c5a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:24.699459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14dec5-e2fb-4898-b950-92425cd2f02a None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:24.733401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:24.734232 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.734497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.734809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.745100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-efbfa7a4-fda1-4449-aa3b-6b975d233114 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:24.752941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:24.753999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:24.754929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:24.758898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 142/300] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:24.760185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.760471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.760756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.771209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19072191-673f-4e9d-a760-a66b375e5c5a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:24.776663 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:24.777962 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:24.797911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:24.806513 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:24.807120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.807408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.807676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.817780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-2d860927-16e3-48d8-aea0-4ec478b2ccaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:24.825693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:24.826879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:24.827997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:24.830904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 159/301] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:24.832491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f109-b39c-4af3-96df-74903ad75623 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.832805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f109-b39c-4af3-96df-74903ad75623 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.833100 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f109-b39c-4af3-96df-74903ad75623 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.834419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 160/302] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:24.835137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f109-b39c-4af3-96df-74903ad75623 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:24.846786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 143/303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:24.847641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:24.862253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:24.947258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f109-b39c-4af3-96df-74903ad75623 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:24.951803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cd665-2887-428e-b204-7850c7c1a4e6 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:24.983536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:24.984260 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.984541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.984812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.985062 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:24.985631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:24.985823 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:24.985936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:24.986111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:24.986390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:24.987223 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:24.987400 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadefb2-329e-424a-bd58-9c6bb9afb41f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:24.987552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:24.989020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:24.996892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 161/304] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.001759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 144/305] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.001935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.002022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.002099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.002099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.016027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:25.017250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:25.065795 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.078772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.087412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 162/306] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:25.088319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.102515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2559192-a7df-4f6c-a8f6-df2d0dca3c92 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.136821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.137672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.137963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.138236 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.139425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.140878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.142515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 145/307] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.143312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.200160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4646c1-af13-4552-8e07-20bc33e4221f None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.233856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.234663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.234977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.235251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] PATH_INFO: `/v3/users/2cb505d441ed4b6a9e27174d36ad53ec` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.245638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5949-7fa1-482c-ba9a-682be819077b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.248395 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb505d441ed4b6a9e27174d36ad53ec)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.249871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.251544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 163/308] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/users/2cb505d441ed4b6a9e27174d36ad53ec => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.252285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.283483 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.284512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.284708 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.284938 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] PATH_INFO: `/v3/users/2fa839ea5d734a0fb9984987603dc728` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.286172 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] RBAC: Authorizing `identity:get_user(user_id=2fa839ea5d734a0fb9984987603dc728)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.287674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.289407 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 146/309] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/users/2fa839ea5d734a0fb9984987603dc728 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.290148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.291731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.305532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.354393 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea559f-39f9-4e94-a8ee-c8ccfc046fe6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.388193 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.389003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.389287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.389397 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82504091-e3fc-4f38-86e3-c959e93d1266 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.389566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.399743 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:25.407587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:25.408784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 164/310] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:25.415167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.428826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.429500 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.429786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.430066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] PATH_INFO: `/v3/groups` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.430817 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.432266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.446903 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 147/311] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 19:57:25 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:25.448326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.521139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.526871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc12c8-3e6a-4134-9775-bdd67717c73a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.543554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.567853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.568538 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.568825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.569108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.569961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, user.id=2cb505d441ed4b6a9e27174d36ad53ec, scope.system=all) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:25.570309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.571823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.577538 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 165/312] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/role_assignments?user.id=2cb505d441ed4b6a9e27174d36ad53ec&scope.system=all&role.id=81431837aa97496cbd08a6753846b0fa => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.578390 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.593573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd682e-6b74-4502-98bf-a3dd99062211 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.645015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.646013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.646487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.647097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.718538 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8272c-eafb-4233-9b9c-a28f0d83371f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.747869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.749389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.768190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.769009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.769300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.769829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.771096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:25.771468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.772841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.784705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 166/313] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.790826 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.817467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.849267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:25.878102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 148/314] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:25.887660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:25.901181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89b9f-d6cf-4c4d-ba9d-d2638e502e78 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:25.937675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:25.938740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:25.939094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:25.939435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] PATH_INFO: `/v3/users/28428fd933a94c4c819db372d3439630` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:25.941810 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] RBAC: Authorizing `identity:get_user(user_id=28428fd933a94c4c819db372d3439630)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:25.942308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:25.948425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 167/315] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/users/28428fd933a94c4c819db372d3439630 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:25.949853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:26.016053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865943-ec14-467b-ab9d-7f2cc31686ec None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:26.045451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:26.053345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:26.054279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:26.054567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:26.054930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:26.056131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:26.056583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985029-c3db-4a62-bf00-a4e15060f426 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:26.057595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:26.059413 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 149/316] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:25 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:26.065151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:26.093085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:26.093965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:26.094242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:26.094511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] PATH_INFO: `/v3/system/users/28428fd933a94c4c819db372d3439630/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:26.096115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=28428fd933a94c4c819db372d3439630, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:26.097607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62bd3a-1682-4d85-9611-90916d6789e9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:26.110408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 168/317] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 19:57:25 2022] PUT /identity/v3/system/users/28428fd933a94c4c819db372d3439630/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:26.122589 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:26.192029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f105ae1-dfe7-4181-a6e8-93762d4d9f01 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:26.231278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:26.232428 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:26.232939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:26.233450 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:26.234501 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979, user.id=2fa839ea5d734a0fb9984987603dc728) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:26.235055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:26.236846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc96706-52a2-4808-8ca5-39a5aeb79edb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:26.244428 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 150/318] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:26 2022] GET /identity/v3/role_assignments?user.id=2fa839ea5d734a0fb9984987603dc728&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=81431837aa97496cbd08a6753846b0fa => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:27.780061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33517-6b23-46b4-919c-76791fc2b737 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:27.780701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33517-6b23-46b4-919c-76791fc2b737 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:27.780701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33517-6b23-46b4-919c-76791fc2b737 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:27.782022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 169/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:27.787582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:27.788031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:27.788129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:27.805490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:27.806731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:27.853719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee2ff-d2be-4d28-be2b-0d10b4031a9e None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:27.853977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee2ff-d2be-4d28-be2b-0d10b4031a9e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:27.854243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aee2ff-d2be-4d28-be2b-0d10b4031a9e None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:27.855821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 170/320] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:27.860981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:27.861270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:27.861546 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:27.878995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:27.882953 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 151/321] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:27.883100 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:27.902928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:27.937457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:27.958842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 171/322] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:27.979544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.013272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773bb6d-2e0f-4e4a-8aae-5bc26aed0688 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.051014 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.051915 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.052395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.052823 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.054173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.055846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.057679 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 152/323] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:28.063300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.070470 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:28.089195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae6b8c-f239-4cf4-abdb-9a4c631a56c6 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.129768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.130972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.131432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.131890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.144432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:28.153096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:28.154471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:28.155594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:28.157922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 172/324] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:28.164204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.171567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d40e00-0834-47a4-9555-f98668e24d96 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.173549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:28.212851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.213532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.213819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.214097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] PATH_INFO: `/v3/groups` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.214824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.216317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.230792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 153/325] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 19:57:28 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:28.277020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86407c-5c5b-40b3-a428-950ccf81729c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.320996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.321763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.322049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.322324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.323146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:28.323511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.325024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c4bb2-671f-470d-86de-d145019d4d8f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.336960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 173/326] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:28.342898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.362009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6be6-48ee-4b44-b790-5561c2cee5e2 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.362265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6be6-48ee-4b44-b790-5561c2cee5e2 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.362547 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d6be6-48ee-4b44-b790-5561c2cee5e2 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.364146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 174/327] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:28.369863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.370131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.370411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.387972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:28.389205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:28.391583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:28.463369 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f634b-60c8-4f8b-a042-99192b514698 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.467822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 175/328] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:28.491250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.505889 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.506973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.507261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.507524 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] PATH_INFO: `/v3/users/2cb505d441ed4b6a9e27174d36ad53ec` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.509111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb505d441ed4b6a9e27174d36ad53ec)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.510822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.517241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 154/329] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:28 2022] GET /identity/v3/users/2cb505d441ed4b6a9e27174d36ad53ec => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:28.518482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.564941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:28.616424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0f78-3cab-430a-ac87-5bed4986cc89 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.664915 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4aa9e-7d3d-4478-a239-ce9c24bd2196 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.669610 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.670437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.670764 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.671049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.682707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:28.686790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:28.699091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:28.700171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:28.701082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:28.704303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 176/330] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:28.711063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:28.719288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.720106 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.720390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.720669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] PATH_INFO: `/v3/system/users/2cb505d441ed4b6a9e27174d36ad53ec/roles/81431837aa97496cbd08a6753846b0fa` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.722182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2cb505d441ed4b6a9e27174d36ad53ec, role_id=81431837aa97496cbd08a6753846b0fa)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.723624 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.741759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 155/331] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 19:57:28 2022] PUT /identity/v3/system/users/2cb505d441ed4b6a9e27174d36ad53ec/roles/81431837aa97496cbd08a6753846b0fa => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:28.844256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e970c8-e13b-4327-8c38-4915ba87fe14 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:28.890480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:28.891268 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:28.891556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:28.891836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:28.892618 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:28.892933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:28.894370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:28.904898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 177/332] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:28.910308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:29.028492 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:29.041477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0610c-df19-440e-b606-6ea6caba81c9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:29.078847 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:29.080155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:29.080659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:29.081157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] PATH_INFO: `/v3/users/28428fd933a94c4c819db372d3439630` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:29.082592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] RBAC: Authorizing `identity:get_user(user_id=28428fd933a94c4c819db372d3439630)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:29.084402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916790-fbd1-414f-a235-0c4f06b30308 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:29.086616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 156/333] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:28 2022] GET /identity/v3/users/28428fd933a94c4c819db372d3439630 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:29.092198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:29.164818 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:29.225541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07615-ba8a-4159-900e-98249d890ad3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:29.278816 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:29.279431 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:29.279718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:29.279993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:29.280849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] RBAC: Adding query filter params (role.id=5c5a76eb30c14603a77919d9ddeb1d95, user.id=28428fd933a94c4c819db372d3439630, scope.system=all) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:29.281165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:29.282625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4094a1-e553-4c1d-90a4-f281337804a9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:29.300169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 178/334] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:57:29 2022] GET /identity/v3/role_assignments?user.id=28428fd933a94c4c819db372d3439630&scope.system=all&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:31.401925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-f1cf-4ec8-a744-dbf4a6d77403 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.402521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-f1cf-4ec8-a744-dbf4a6d77403 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.402521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad1e4-f1cf-4ec8-a744-dbf4a6d77403 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.403931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 157/335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:31.410128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab68f3-8b47-4e14-9791-4241b5ce5d70 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.410583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab68f3-8b47-4e14-9791-4241b5ce5d70 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.410898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab68f3-8b47-4e14-9791-4241b5ce5d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.428226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-5dab68f3-8b47-4e14-9791-4241b5ce5d70 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:31.429417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-5dab68f3-8b47-4e14-9791-4241b5ce5d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:31.505093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 179/336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:31.529111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad1e4-f1cf-4ec8-a744-dbf4a6d77403 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:31.552473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda1b2-a495-4e27-af0c-9f180a711a0e None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.552795 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda1b2-a495-4e27-af0c-9f180a711a0e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.553032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda1b2-a495-4e27-af0c-9f180a711a0e None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.554808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 180/337] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:31.560400 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bc5c-80df-44ce-b425-5cdab51af75f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.560680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bc5c-80df-44ce-b425-5cdab51af75f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.560962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bc5c-80df-44ce-b425-5cdab51af75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.591291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-76d8bc5c-80df-44ce-b425-5cdab51af75f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:31.592492 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-76d8bc5c-80df-44ce-b425-5cdab51af75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:31.650585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:31.653479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad1e4-f1cf-4ec8-a744-dbf4a6d77403 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:31.677624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 181/338] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:31.679170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a225f-2845-4913-9033-91b418c5551e None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.679458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a225f-2845-4913-9033-91b418c5551e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.679734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a225f-2845-4913-9033-91b418c5551e None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.681405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 182/339] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:31.687514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.688077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.688532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.689734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:31.690815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.691285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.691767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.702797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:31.711135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:31.712180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:31.713097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 158/340] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:31.713854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:31.717636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:31.718970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:31.739391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:31.800562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 183/341] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:31.801919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:31.821568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98708c-b5ab-4dcf-8322-d92d3c5227f5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:31.856772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:31.857886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.858336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.858794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.872544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:31.880976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:31.882196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:31.883345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:31.885887 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 159/342] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:31.886979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:31.920740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb11595-1ba3-4790-b01e-3baab90ac354 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:31.934001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:31.972859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:31.973820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:31.974200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:31.974590 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:31.975890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:31.975890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:31.977829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:31.987693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 184/343] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:31.988675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:31.996776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.033639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0ae8-da06-43c6-b37f-841e57d66bb1 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.103486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.104307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.104589 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.104864 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.120322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:32.128209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:32.129226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:32.130545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 160/344] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:32.132623 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:32.196251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f52fc-6ce1-43e0-8912-26b65828c4af None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.241366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.242059 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.242346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.242623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.243547 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:32.243954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:32.245355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:32.255282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 185/345] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:32.255908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:32.290892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc01846-9753-48c6-b467-036d7d91b0b4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.307102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.327876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.329061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.329457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.329740 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.343602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.399231 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9bc2c-3111-40b3-a59e-1e049bc59845 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.411146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:32.412662 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823ee4f-f9dd-4cdc-93ac-d896427fb06e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:32.444557 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.446116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.446897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.447347 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.448885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:32.449397 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:32.451928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e157-2521-4877-8ac4-407a320ac058 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:32.464447 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 186/346] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:32.466913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566c6b-6aa3-453e-b636-d9a02027521c None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.467356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566c6b-6aa3-453e-b636-d9a02027521c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.467807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566c6b-6aa3-453e-b636-d9a02027521c None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.469231 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 187/347] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:32.470212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566c6b-6aa3-453e-b636-d9a02027521c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:32.545037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 161/348] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:32.547107 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.547737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.548195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.574313 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:32.576155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:32.588026 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.597872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566c6b-6aa3-453e-b636-d9a02027521c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.634435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.651711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.652887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.653173 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.653458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.690898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 162/349] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:32.692588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:32.756914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:32.759206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:32.823341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115f0b-54c5-42d5-a945-b94c9afba7b6 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:32.861058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:32.861731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:32.862013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:32.862287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:32.885184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 188/350] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:32.887028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:32.892864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.922049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:32.953613 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:32.955676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.032701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b7070-ec23-40e7-abdf-b07b3f89a38f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.085762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.086972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.087116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.087439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.088796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.090478 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.092850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 189/351] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:32 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.094970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.095552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 163/352] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:33.096657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.174719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.205132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.231246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671f855-308c-43b2-bd8b-7cbf103ad074 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.237542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1672f-7b6b-47b5-86c8-593228c49bf0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.273200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.274017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.274300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.274573 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.278512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.279706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.280199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.280669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.284023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.285533 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6111dd5-28e8-4650-89ac-65941ca432f8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.287436 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:33.288370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 164/353] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.289721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe0c7-eb77-4ab0-a6ea-2d04f9047030 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.290013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe0c7-eb77-4ab0-a6ea-2d04f9047030 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.290293 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fe0c7-eb77-4ab0-a6ea-2d04f9047030 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.292890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 165/354] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:33.292890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe0c7-eb77-4ab0-a6ea-2d04f9047030 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:33.300124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:33.301163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:33.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 190/355] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:33.303394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.424968 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c1749-7bd2-4348-b8db-96a000b72d50 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.428833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fe0c7-eb77-4ab0-a6ea-2d04f9047030 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.451944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.466185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.466412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.467148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.467340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.467453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.467625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.467722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.467904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.469124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.470995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec023b3-bae0-423c-9b99-2054ab071552 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.472624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 191/356] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.477793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.477793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.477793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.478280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.479695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.482940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 166/357] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.482940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.488001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.495013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:33.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:33.570504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 192/358] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:33.571318 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.608368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a87c3-6d70-47bb-b8c5-8a94a1092b04 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.665325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.666454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.666937 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.667398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.669748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.672273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12a1ba-a464-4ba0-9a9f-f3626e042ff8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.676078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 167/359] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.677374 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb004-2466-41ce-b956-95cffd97a81b None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.677839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb004-2466-41ce-b956-95cffd97a81b None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.678295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648bb004-2466-41ce-b956-95cffd97a81b None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.680604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 168/360] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:33.682325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bb004-2466-41ce-b956-95cffd97a81b None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.704125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d682d9-7341-41bb-a4b4-8bf9d18490f8 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.732518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.752144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.753541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.753822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.754092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.754876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] RBAC: Adding query filter params (name=reader) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:33.755182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.756565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.767276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 193/361] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.768332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.774466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:33.812933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648bb004-2466-41ce-b956-95cffd97a81b None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.854371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.855561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.857371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.857371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.858366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.859909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.862176 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 169/362] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.862806 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.895352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c0967-5738-4f5b-a713-74c96fd2293d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:33.934547 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:33.935373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:33.935666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:33.935942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:33.936784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:33.937096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:33.938549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:33.946731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 194/363] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:33.947459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:33.991249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d84c0-962e-46cd-8767-317f2bf132e3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.013842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.051338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.052184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.052463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.052734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.067950 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.072719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-6000968c-89f2-4c1d-b238-313247b27762 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:34.081165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:34.082247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:34.083298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 170/364] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:34.084067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.084505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.084619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.094734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbc750-2796-48af-9ccf-98ccdd7e105b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.103317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:34.104641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:34.148287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.148510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.148789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.149065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.149930 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=87eac1825a58408795d196c24623a9c8) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:34.150222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.151714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:34.159333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 195/365] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:33 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:34.160237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.189375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 171/366] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:34.190562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.323105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0916fc-70b9-4cc8-85bf-69af11e24c85 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.339776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.341572 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cd9da-9cd4-4f1a-899c-6e9472dec8ee None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.380633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.381703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.382094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.382472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] PATH_INFO: `/v3/users/2cb505d441ed4b6a9e27174d36ad53ec` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.384985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] RBAC: Authorizing `identity:get_user(user_id=2cb505d441ed4b6a9e27174d36ad53ec)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.387370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.387506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:34.389290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 196/367] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/users/2cb505d441ed4b6a9e27174d36ad53ec => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:34.391175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.396565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.397490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.397937 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.398368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.399402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=87eac1825a58408795d196c24623a9c8) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:34.399879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.401513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:34.410125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 172/368] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:34.410978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.580939 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad20c33-0aec-4d0b-8f5a-3b68da1a1c64 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.621545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cf3ca-6b56-47de-901c-0888b916d7b6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.638346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.639084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.639367 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.639646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.640406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:34.641106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.642505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:34.653272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 197/369] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:34.654892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.686526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.687362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.687642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.687914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.699692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:34.704545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:34.708155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:34.709161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:34.710047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 173/370] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:34.710876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.771416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:34.794278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5442d8-6c86-42d5-aa9a-023c844647c8 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.815217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688f1a-17fe-43f5-8eaf-5674c1319bc8 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:34.849827 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.850642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.851049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.851418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.863209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:34.864118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:34.864633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:34.865065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:34.866160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] RBAC: Adding query filter params (role.id=81431837aa97496cbd08a6753846b0fa, user.id=2cb505d441ed4b6a9e27174d36ad53ec, scope.system=all) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:34.866634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.868262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:34.891010 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 198/371] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/role_assignments?user.id=2cb505d441ed4b6a9e27174d36ad53ec&scope.system=all&role.id=81431837aa97496cbd08a6753846b0fa => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:34.892103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:34.937509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:34.939168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.030902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:35.094454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 174/372] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:35.100134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:35.125153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:35.131055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540e950-7416-491f-9fb5-1fed92fbd472 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.195502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.196165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.196455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.196783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.197662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:35.198079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.199545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.220511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 199/373] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:35.224207 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:35.236658 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d72df9-6de9-4efa-a0d4-ad82d3e7ce33 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.286986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.287863 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.288141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.288426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.290359 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.291833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.293575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 175/374] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:35.303762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:35.347888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:35.406315 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5c65-7684-403d-a557-69359d05de9c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.443235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895db8-d407-40b1-903b-f27366294adb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.462886 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.463480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.463763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.464041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.481742 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.482613 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.482918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.484546 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.486406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.487899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.489541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 176/375] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:35.496896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:35.519733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:35.588977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.590497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.681311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:35.700720 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6243f-eec4-4795-86d0-adef17c3f9e8 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.766195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.766806 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.767089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.767366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.768205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:35.768515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.769955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.776375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 177/376] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:35.798212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 200/377] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:35.803757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:35.929912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719c45-33f4-4584-83a3-6ce696f40907 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:35.980259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:35.983922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:35.984623 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:35.985122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] PATH_INFO: `/v3/projects/da3444a3ecd54495b9846ca0dce0475a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:35.986780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] RBAC: Authorizing `identity:get_project(project_id=da3444a3ecd54495b9846ca0dce0475a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:35.988449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:35.990376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 178/378] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/projects/da3444a3ecd54495b9846ca0dce0475a => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:35.999238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:36.084783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:36.131294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c123e-e85e-4fee-b8b8-d1f8d5a31766 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:36.176995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:36.177876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:36.178156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:36.178427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] PATH_INFO: `/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:36.185374 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] RBAC: Authorizing `identity:get_group(group_id=8fbf9be623cb423fb444b8e26b10a1f0)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:36.186843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa52ce6-8325-4082-a9f2-7cc5f37b325b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:36.188907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 201/379] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:35 2022] GET /identity/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:36.194420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:36.231158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:36.324850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a1f4-1369-4e40-94cf-6637284e8bcf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:36.368041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:36.368637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:36.368923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:36.369194 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:36.370031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] RBAC: Adding query filter params (group.id=8fbf9be623cb423fb444b8e26b10a1f0, role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=da3444a3ecd54495b9846ca0dce0475a) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:36.370341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:36.371836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6144a0-80f4-4260-88ac-d26b2f6ae61e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:36.378749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 179/380] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:36 2022] GET /identity/v3/role_assignments?group.id=8fbf9be623cb423fb444b8e26b10a1f0&scope.project.id=da3444a3ecd54495b9846ca0dce0475a&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:36.697379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d045fd-c6f4-46dc-ae5c-daef0a84f494 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:36.698410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d045fd-c6f4-46dc-ae5c-daef0a84f494 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:36.698973 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d045fd-c6f4-46dc-ae5c-daef0a84f494 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:36.700938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 202/381] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:36.714440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000e3-3c0a-4f0e-8ad1-fedceec6dd63 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:36.715142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000e3-3c0a-4f0e-8ad1-fedceec6dd63 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:36.715142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a000e3-3c0a-4f0e-8ad1-fedceec6dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:36.735085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-51a000e3-3c0a-4f0e-8ad1-fedceec6dd63 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:36.736291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-51a000e3-3c0a-4f0e-8ad1-fedceec6dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:36.828052 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 180/382] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:36.850997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d045fd-c6f4-46dc-ae5c-daef0a84f494 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.015906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d045fd-c6f4-46dc-ae5c-daef0a84f494 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.047976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fa7d8-0c29-4f09-b80a-b9f70c753960 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.048659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fa7d8-0c29-4f09-b80a-b9f70c753960 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.049138 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fa7d8-0c29-4f09-b80a-b9f70c753960 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.051046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 181/383] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:37.056448 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.057129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.057635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.057799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.076210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.077033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.077228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:37.077366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.077574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.078978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:37.094288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.102734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:37.115254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:37.116267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:37.117162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:37.118317 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 203/384] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:37.124905 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.208633 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 182/385] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:37.248482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.284378 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d650021-f9df-4581-bdea-e839276c3960 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.361609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.362298 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.362582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.362880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.363637 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:37.364024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:37.365518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:37.371352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbc25f-c3ee-437b-8ab0-ad0c422fd65f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.386548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 204/386] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:37.392102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.413505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.414349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.414631 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.415088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.429311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1a00220d-4453-4696-a7a3-b4c75f65146a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:37.440133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:37.441406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:37.442547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:37.445770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 183/387] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:37.447284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee455-bcae-4fff-864c-1ebb79fb0c37 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.447732 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee455-bcae-4fff-864c-1ebb79fb0c37 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.448161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee455-bcae-4fff-864c-1ebb79fb0c37 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.449901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 184/388] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:37.451336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ee455-bcae-4fff-864c-1ebb79fb0c37 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.463339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.467008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.513170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b060aa-95c4-4dec-96c9-24c230924726 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.547404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899525ed-5577-4300-9079-514f2e917efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.548664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899525ed-5577-4300-9079-514f2e917efe None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.549162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899525ed-5577-4300-9079-514f2e917efe None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.549679 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899525ed-5577-4300-9079-514f2e917efe None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.551713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899525ed-5577-4300-9079-514f2e917efe None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:37.553416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899525ed-5577-4300-9079-514f2e917efe None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:37.555745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 205/389] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:37.557164 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.557670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.558205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.579575 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:37.581013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ee455-bcae-4fff-864c-1ebb79fb0c37 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.581526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:37.624634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.625362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.625647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.625919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.626879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:37.627189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:37.629536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:37.642757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 185/390] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:37.643922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.671295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 206/391] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:37.672906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.724941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.732422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.767965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943640e5-2b9a-4469-9852-24092bb61d2c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.801233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263baf1-025d-42b1-98fd-7985038e8097 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.808362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.809613 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.810052 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.810491 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.812361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:37.814011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:37.821466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 186/392] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:37.821466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.848288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.849510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.850008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.850467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.852406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:37.854151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:37.861019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 207/393] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:37.862168 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:37.929286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbe1bb-6896-4864-af31-385aac440401 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.970374 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86703bf-e29e-4017-81b7-26ab1d98d165 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:37.972416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:37.973227 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:37.973508 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:37.973781 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:37.979711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.994058 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:37.997211 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:38.007070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:38.008112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:38.009024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 187/394] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:38.009784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.027293 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.028718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.029182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.029614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.032456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, group_id=78b27f3983b64ee7bd7684e75bfdbc94, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.034739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.058803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 208/395] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:57:37 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:38.058803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.193843 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8232-edc5-423e-8e4f-c8351de556a9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.259549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e2d6-48c8-4d38-976f-1c15d054ed82 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.265890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.266824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.267112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.267391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.275614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.277108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.279087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 188/396] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:38.285977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.310336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.311032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.311321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.311603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.312385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:38.312699 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.314287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.324676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 209/397] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:38.332560 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.386731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:38.389735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:38.454352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2406-19fb-4c25-8e4e-27b28ac7f461 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.522501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52ae47-e80a-4ce3-9d47-d2126c377c52 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.525798 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.526821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.527108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.527447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.532407 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, group_id=78b27f3983b64ee7bd7684e75bfdbc94, role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.533914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d13-545d-4551-81fd-75f174b924d9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.551420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 189/398] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:57:38 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/b56351c81b57421dad2ef84f35fe7238 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:38.558549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87897-1e97-40f6-91df-70cc5e88209d None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.559146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87897-1e97-40f6-91df-70cc5e88209d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.559529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87897-1e97-40f6-91df-70cc5e88209d None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.561145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 190/399] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:38.568280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.568643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.568847 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.594912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.595811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.596097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.596373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.598920 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.600420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.602495 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 210/400] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:38.607060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:38.608298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:38.609602 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.752642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 191/401] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:38.791131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.801351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727fbb7-e48a-4889-942d-0fc434184588 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.812143 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:38.863349 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.864664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.865151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.865650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.867501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:38.869331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:38.871932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:38.872201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 211/402] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:38.879708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:38.918153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6095226-8187-49bd-88e5-85b3ee79aca7 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:38.954879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:38.955909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:38.956203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:38.956482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:38.978965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:38.987509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:38.988569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:38.990123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 192/403] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:38.998729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.074222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a698-00ac-4c68-b103-aaba6f9b9aaf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.108424 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e113e-0c57-48bf-ae30-39dbcb9cbaf2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.122502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.123435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.123716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.123993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/5c5a76eb30c14603a77919d9ddeb1d95` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.126012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=87eac1825a58408795d196c24623a9c8, group_id=78b27f3983b64ee7bd7684e75bfdbc94, role_id=5c5a76eb30c14603a77919d9ddeb1d95)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.127515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.131865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:39.145261 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 212/404] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:57:38 2022] PUT /identity/v3/projects/87eac1825a58408795d196c24623a9c8/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/5c5a76eb30c14603a77919d9ddeb1d95 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:39.165544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.166238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.166559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.166865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.167640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:39.168004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.169500 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b42d9-b07a-4e7a-ab87-9a5cee71055b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.179824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 193/405] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:39.185753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.212199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951c0-aa22-443a-bf84-896a19602933 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.212545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951c0-aa22-443a-bf84-896a19602933 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.212759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951c0-aa22-443a-bf84-896a19602933 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.214440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 194/406] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:39.220525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.220906 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.221253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.225827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:39.243634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:39.245046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:39.321841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c27db-c51f-403b-9cff-0537f41a2bb0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.327365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 195/407] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:39.351772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.360741 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.362030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.362330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.362608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.363888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.365710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.368384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 213/408] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:39 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:39.376616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.511057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916e966-eb60-4b98-8532-6d0eb88f76f2 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.519678 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:39.540117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:39.546385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb4ef-f0bd-48bf-9a48-a40c75362945 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.549991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.551341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.551628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.551914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.563825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:39.573955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:39.576304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:39.578447 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 196/409] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:39.582930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.588909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.589849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.590144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.590423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.591689 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.593741 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.596227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 214/410] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:39 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:39.603951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.771025 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274c9a1-ab43-4c89-95e9-58c2e0d40409 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.788029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7ee34-c75f-4fe1-b979-c25a8590eef2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:39.832373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.834048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.834518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.835037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.837563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3888c9fd54084f5ebbb366e97a5ef979, group_id=78b27f3983b64ee7bd7684e75bfdbc94, role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.839365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.850829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:39.851557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:39.851828 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:39.852468 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:39.853225 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:39.853567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:39.855044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:39.856427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 215/411] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:57:39 2022] PUT /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979/groups/78b27f3983b64ee7bd7684e75bfdbc94/roles/b56351c81b57421dad2ef84f35fe7238 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:39.877025 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 197/412] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:39.882789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:39.934650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:40.029376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0af9f-05aa-4625-a555-1dca76e7cbb4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:40.072569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:40.073528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:40.073818 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:40.074154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] PATH_INFO: `/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:40.079638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] RBAC: Authorizing `identity:get_group(group_id=8fbf9be623cb423fb444b8e26b10a1f0)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:40.081155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:40.083355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 216/413] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:39 2022] GET /identity/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:40.088948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:40.140453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:40.221233 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707fca-1a82-46c1-86a9-d02da4bb2d31 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:40.257881 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:40.259234 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:40.259746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:40.260247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] PATH_INFO: `/v3/projects/da3444a3ecd54495b9846ca0dce0475a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:40.261774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] RBAC: Authorizing `identity:get_project(project_id=da3444a3ecd54495b9846ca0dce0475a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:40.265552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5980-f3ab-40b0-90bd-ebe34440d61d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:40.267894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 198/414] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:40 2022] GET /identity/v3/projects/da3444a3ecd54495b9846ca0dce0475a => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:40.273996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:40.400388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:40.409549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446a5ac-13d3-4ad1-8516-7442c7e818c2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:40.450183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:40.451533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:40.452054 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:40.452536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] PATH_INFO: `/v3/projects/da3444a3ecd54495b9846ca0dce0475a/groups/8fbf9be623cb423fb444b8e26b10a1f0/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:40.459437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=da3444a3ecd54495b9846ca0dce0475a, group_id=8fbf9be623cb423fb444b8e26b10a1f0, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:40.461119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf30f48-c8bc-41e3-8f8d-3189d38677b1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:40.484614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 217/415] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 19:57:40 2022] PUT /identity/v3/projects/da3444a3ecd54495b9846ca0dce0475a/groups/8fbf9be623cb423fb444b8e26b10a1f0/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:57:40.804057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1282-8a1d-49e0-b978-46d050404a8d None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:40.804569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1282-8a1d-49e0-b978-46d050404a8d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:40.804569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1282-8a1d-49e0-b978-46d050404a8d None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:40.806312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 199/416] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:40.811876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:40.812175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:40.812462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:40.831071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:40.832274 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:40.903316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 218/417] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:40.936885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d1282-8a1d-49e0-b978-46d050404a8d None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:41.053770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:41.061883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d1282-8a1d-49e0-b978-46d050404a8d None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:41.099383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:41.100614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.101115 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.101598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] PATH_INFO: `/v3/roles/member` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.113172 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d194c101-5a7e-4c9e-b4ae-0c8d8b6f295a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:41.121295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:41.122284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:41.123242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:41.125991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 200/418] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:41.134733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:41.296151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a1aa-f061-43ec-aa62-3fde93f6cedf None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.296555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a1aa-f061-43ec-aa62-3fde93f6cedf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.296764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a1aa-f061-43ec-aa62-3fde93f6cedf None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.297262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:41.298486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 201/419] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:41.307838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.308155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.308434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.327614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528d4e7-5bcf-4388-849a-efe884b15c88 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:41.339731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:41.342974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:41.390192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:41.391258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.391758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.392233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.393205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] RBAC: Adding query filter params (name=member) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:41.393730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:41.395404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:41.409232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 219/420] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:41.414639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:41.481576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 202/421] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:41.517543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:41.588824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fea27-afed-4243-920d-2479d9788e63 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:41.625021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:41.644227 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed2d4d-0023-4220-bb64-762bd5c6a309 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:41.686115 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:41.688327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.688619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.688898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.693316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:41.693977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.694260 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.694537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.714658 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:41.726711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:41.728192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:41.729272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:41.729947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:41.730067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 203/422] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:41.736067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:41.836404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:41.837877 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:41.899971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f384f-7006-43a8-882b-fa3a12295f99 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:41.959006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:41.959717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:41.960003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:41.960284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:41.961057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:41.961372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:41.962838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:41.983543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 204/423] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:41.984450 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.005031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.029960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 220/424] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:42.035666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.120308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.145941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64c45-14fd-41ab-b082-77c7ecf0f7fb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.181469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bc665-e935-45b8-b743-d3bc4f68d77b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.191530 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.192365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.192759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.193408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.228529 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.229984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.230943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.231397 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.233093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.235993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43aa3e-d874-4d85-8ec6-ee56bf3b92b6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.238230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 221/425] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:42.239699 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b1a-845b-4ec7-b762-a478253ab6b6 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.240170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b1a-845b-4ec7-b762-a478253ab6b6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.240603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b1a-845b-4ec7-b762-a478253ab6b6 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.247183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 222/426] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:42.247639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78b1a-845b-4ec7-b762-a478253ab6b6 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.276966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.278551 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e54b-a877-43f2-b023-6d1bba1934af None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.290482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.378289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff78b1a-845b-4ec7-b762-a478253ab6b6 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.398048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.400993 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 205/427] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:42.402878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.403570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.404016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.422321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add061-928d-482a-9472-440f541c03e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.422927 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:42.423472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add061-928d-482a-9472-440f541c03e1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.423874 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add061-928d-482a-9472-440f541c03e1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.424261 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18add061-928d-482a-9472-440f541c03e1 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.424827 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:42.425598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18add061-928d-482a-9472-440f541c03e1 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.427459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18add061-928d-482a-9472-440f541c03e1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.430437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 223/428] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:42.431396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add061-928d-482a-9472-440f541c03e1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.508687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 206/429] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:42.509935 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.576983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.588525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18add061-928d-482a-9472-440f541c03e1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.638278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.639447 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.639910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.640344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.641921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.643602 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.646103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 224/430] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:42.647332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.652544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5257e5-c2f5-4993-93c4-8a0e283aa39a None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.693666 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.694337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.694629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.694926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.695892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:42.696213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.697669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febba422-8880-4f88-894f-75aad66cf088 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.699335 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 207/431] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988082-fe58-4748-a445-4290276db91b None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988082-fe58-4748-a445-4290276db91b None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988082-fe58-4748-a445-4290276db91b None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 208/432] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:42.710718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25988082-fe58-4748-a445-4290276db91b None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.767522 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131eb96-3e47-47c6-b5c5-0849db1c5ee7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.805369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.806195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.806479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.806786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.819469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-249706fd-e052-4b0a-ab9a-3d5f5030b397 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:42.827666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:42.828763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:42.829673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 225/433] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:42.830504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.830504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.831440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.856162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25988082-fe58-4748-a445-4290276db91b None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:42.858126 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:42.861574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:42.863216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:42.902281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:42.904230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:42.904727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:42.905231 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:42.906733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:42.908459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:42.910793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 209/434] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:42.911975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.947458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 226/435] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:42.948713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:42.994753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.041811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d2df2-e989-42bd-bb86-6611c19c1b09 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.064224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b941a54-803c-4f2b-8121-7fc0ff573057 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.079314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.080371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.080936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.081544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.082512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] RBAC: Adding query filter params (name=member) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:43.083067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.084831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.094179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 210/436] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.095333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.099943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.101087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.101087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.101286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.102303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=87eac1825a58408795d196c24623a9c8) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:43.102619 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.104117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.110423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 227/437] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:42 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.111297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.138148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.219463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da65c-a5fe-4696-aa7b-0faa952c2f73 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.225457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c40f1-cc9a-4ea5-b466-91d6f9e8aa56 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.230024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.257432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.258272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.258565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.258875 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.268747 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.269793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.270267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.270783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.270959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1e873d52-8495-4f60-97ba-2e5837572ae2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:43.279335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:43.280423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:43.281327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 211/438] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:43.282471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6710-449d-4c54-82a2-a097d7f756ee None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.282471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6710-449d-4c54-82a2-a097d7f756ee None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.282621 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6710-449d-4c54-82a2-a097d7f756ee None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.284211 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 212/439] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:43.286559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6710-449d-4c54-82a2-a097d7f756ee None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.359770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.361174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.395930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.406327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6710-449d-4c54-82a2-a097d7f756ee None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.440440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.441112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.441431 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.441711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.442459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:43.442814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.444209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929230-829f-4322-b51b-d8b0cbd27931 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.452622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 213/440] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.453860 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.454116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.454387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.460695 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 228/441] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:43.461528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.465881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.470882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:43.472069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:43.536398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 214/442] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:43.537240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.560942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85cf8-4dde-42fe-afc3-9b8fcb19e5bd None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.600030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.600694 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.600977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.601258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.632079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.648224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e462c21-c349-4f22-b000-0c9fb38adfdb None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.671190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.672696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.675373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.682576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.683540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.683820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.684092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] PATH_INFO: `/v3/projects/87eac1825a58408795d196c24623a9c8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.685269 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] RBAC: Authorizing `identity:get_project(project_id=87eac1825a58408795d196c24623a9c8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.686715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.688420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 215/443] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/projects/87eac1825a58408795d196c24623a9c8 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.689159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.772692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 229/444] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:43.773918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.789719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b463d-4134-49cb-bcc1-d038b5751b14 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.823346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.824193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.824479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.824759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.834972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:43.842722 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:43.843921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 216/445] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:43.844844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.863538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.874021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1f6ca-10ab-4ad4-bed4-488a11818121 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.876361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:43.909221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.910027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.910285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.910565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.911780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.913249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.914913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 230/446] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.915666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:43.953326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735fa33-6da0-4cea-9616-5dc611d748cf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:43.987576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:43.988452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:43.988742 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:43.989021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] PATH_INFO: `/v3/projects/3888c9fd54084f5ebbb366e97a5ef979` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:43.990252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=3888c9fd54084f5ebbb366e97a5ef979)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:43.991750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:43.993477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 217/447] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/projects/3888c9fd54084f5ebbb366e97a5ef979 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:43.994232 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.019621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd49b3d-0204-4b97-941d-d088fce60edf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.054695 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.055359 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.055643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.055923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.056678 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:44.056986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.058409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.066780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 231/448] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:44.067509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.077675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.097347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054f7f-3eb2-46f1-91c5-66bb45e18fd8 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.102531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.132157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.132820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.133101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.133374 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.134194 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=5c5a76eb30c14603a77919d9ddeb1d95, scope.project.id=87eac1825a58408795d196c24623a9c8) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:44.134505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.135989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.142135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 218/449] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:43 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=87eac1825a58408795d196c24623a9c8&role.id=5c5a76eb30c14603a77919d9ddeb1d95 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:44.142956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.173671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a627d8-4d04-4347-88e5-d4c05d52c2bc None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.216183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.217433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.217864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.218287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] PATH_INFO: `/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.219736 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] RBAC: Authorizing `identity:get_group(group_id=78b27f3983b64ee7bd7684e75bfdbc94)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.221385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.223344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 232/450] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/groups/78b27f3983b64ee7bd7684e75bfdbc94 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:44.229703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.271419 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079971c-14a6-4560-9c9e-c79258cc9878 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.310160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.310862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.311151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.311408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.328146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.348362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511143-287a-4a4d-bf98-3230271a258d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.350961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.389998 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.391525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.393246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.394084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.395220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.395510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.396359 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] RBAC: Adding query filter params (group.id=78b27f3983b64ee7bd7684e75bfdbc94, role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=3888c9fd54084f5ebbb366e97a5ef979) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:44.397064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.398722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.406032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 233/451] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/role_assignments?group.id=78b27f3983b64ee7bd7684e75bfdbc94&scope.project.id=3888c9fd54084f5ebbb366e97a5ef979&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:44.515758 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 219/452] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:44.521698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.653754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3a820-dd93-448f-b18d-18860a93a864 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.688042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.688919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.689208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.689489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] PATH_INFO: `/v3/projects/da3444a3ecd54495b9846ca0dce0475a` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.690678 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] RBAC: Authorizing `identity:get_project(project_id=da3444a3ecd54495b9846ca0dce0475a)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.692160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.693886 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 234/453] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/projects/da3444a3ecd54495b9846ca0dce0475a => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:44.699779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.745956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.800439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986d12e-daeb-46a4-936c-8af374cfa3f6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.834323 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.835263 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.835539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.835807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] PATH_INFO: `/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.836969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] RBAC: Authorizing `identity:get_group(group_id=8fbf9be623cb423fb444b8e26b10a1f0)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.838409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5da263-99df-4620-9c41-da1fcff01666 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:44.840225 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 220/454] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/groups/8fbf9be623cb423fb444b8e26b10a1f0 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:44.846185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:44.885808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:44.957581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c886c-0bf3-497d-b79e-f9d3771bb4d5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:44.990959 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:44.991620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:44.991909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:44.992215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:44.993045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] RBAC: Adding query filter params (group.id=8fbf9be623cb423fb444b8e26b10a1f0, role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=da3444a3ecd54495b9846ca0dce0475a) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:44.993354 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:44.994821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1b35d-940f-42ed-b4ab-0efb5c3d48a6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:45.001537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 235/455] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 19:57:44 2022] GET /identity/v3/role_assignments?group.id=8fbf9be623cb423fb444b8e26b10a1f0&scope.project.id=da3444a3ecd54495b9846ca0dce0475a&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:47.634967 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40bc30-662e-4f59-99ea-c45fc8f23386 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:47.635408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40bc30-662e-4f59-99ea-c45fc8f23386 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:47.635507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40bc30-662e-4f59-99ea-c45fc8f23386 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:47.637234 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 221/456] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:47.642351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:47.642804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:47.642929 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:47.667763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:47.669345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:47.745782 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee28f5-18a1-40bc-b634-cd28f54adc57 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:47.746049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee28f5-18a1-40bc-b634-cd28f54adc57 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:47.746332 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee28f5-18a1-40bc-b634-cd28f54adc57 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:47.748006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 222/457] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:47.753611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:47.753902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:47.754187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:47.763584 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 236/458] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:47.780461 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:47.781960 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:47.789080 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:47.834898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:47.892840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 223/459] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:47.929254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:47.939711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76bcf9-4017-443e-a6ed-5d9948c61040 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:47.977808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:47.978631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:47.978940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:47.979217 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:47.999339 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.000820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.016163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:48.032067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:48.033072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:48.034119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:48.034119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:48.034119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.034119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:48.034119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 237/460] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:48.039656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.099100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbfa63-f087-42ce-9cee-f2f6d03c96d9 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.176300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.177027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.177306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.177579 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.200237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.201861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.216055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:48.235203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:48.236367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:48.237498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:48.237498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:48.237498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.237498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:48.239202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 224/461] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:48.247847 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.253462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbadd2-3886-4005-ac09-e1600b83d634 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.307018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.307701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.307986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.308481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.309222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:48.309531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.310953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081e1a0-aedb-4fbd-931c-b406a88d7a04 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.322660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 238/462] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:48.324199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bebb-c018-4ff3-8f04-358946749243 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.324480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bebb-c018-4ff3-8f04-358946749243 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.324753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491bebb-c018-4ff3-8f04-358946749243 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 239/463] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c31e-12cc-4bd4-8b90-ea78cb5046d0 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c31e-12cc-4bd4-8b90-ea78cb5046d0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5c31e-12cc-4bd4-8b90-ea78cb5046d0 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 240/464] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:48.330104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5c31e-12cc-4bd4-8b90-ea78cb5046d0 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.365306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.373119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b7ce5-b850-45ef-9fad-b3b951482c1a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.413462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.414220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.414419 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.414710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.415449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:48.415760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.417178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a289aa-8d19-4718-97f4-a59ecc247dcc None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.429700 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 225/465] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:48.435192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.435486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.435766 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.437756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5c31e-12cc-4bd4-8b90-ea78cb5046d0 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.454167 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:48.455389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:48.472343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.473013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.473291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.473549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.474269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.475777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2dd65-c570-4cfc-ae7a-061dd1a30161 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.486561 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.498799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 241/466] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:48 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:48.511107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.511107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.511107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.533329 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:48.534918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:48.538298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 226/467] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:48.539204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.661525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 242/468] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:48.662715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.681969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.706250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8587-fb87-42ed-be7c-d58a51ee4c76 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.751821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.752833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.753303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.753816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.754753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.756417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.780647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 227/469] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:48 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:48.782782 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.807940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31413fe-e91c-450c-9ed7-24b4cb166885 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.841616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:48.854055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.855395 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.855887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.856175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.874632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.876252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:48.901352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:48.902461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:48.903448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:48.903448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:48.903448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.903448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:48.907203 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 243/470] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:48.910410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:48.918206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4978-1d03-4904-951c-ec6c78745361 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:48.957192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:48.959605 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:48.960151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:48.961203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:48.978189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:48.980160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:48.999582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:49.000638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:49.001585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:49.001585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:49.001585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:49.001585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:49.007617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:49.008070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 228/471] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:49.010923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:49.112361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883215-ce7e-4096-aa23-dc2ca5ee7d85 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.127072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa682a-74e2-4745-a491-d63409306745 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.154911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.155867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.156075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.156350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.157107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:49.157524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:49.158896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:49.169507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.170614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.171137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.171636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.172573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:49.173170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:49.173294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 244/472] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:49.175036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:49.178850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:49.196162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 229/473] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:49.197735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:49.223201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:49.257189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:49.299129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17d0b5-83b6-41d4-8ce8-33fec78c2a47 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.316656 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348c4a-c74c-411a-a784-dfd221815b95 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.342860 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.343555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.343846 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.344130 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.344855 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:49.346433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da4dcc-3c05-462e-ac12-797591f1ae37 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:49.355400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.356470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.357112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.357604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.358603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:49.360391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d25017-5e33-45b7-8f2c-6452274965ff None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:49.382986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 245/475] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:49 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:49.387605 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 230/475] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:49 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:57:49.394375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9907e-72bd-4cb6-8eaa-c38b6570c6db None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.395033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9907e-72bd-4cb6-8eaa-c38b6570c6db None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.395524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9907e-72bd-4cb6-8eaa-c38b6570c6db None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.397172 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 246/476] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:49.404020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.404370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.404596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.439247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:49.440508 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:49.542453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 231/477] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:49.574370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9907e-72bd-4cb6-8eaa-c38b6570c6db None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:49.682656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:49.692303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9907e-72bd-4cb6-8eaa-c38b6570c6db None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.727471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.728162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.728445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.728721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.729477 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:49.731102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:49.740386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.sql.core [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:57:49.740386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:57:49.740386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [parameters: {'id': 'c855f0d230174908b8a2ec2936a9d44b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:57:49.740386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144063) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application conn.query(q) May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application result.read() May 19 19:57:49.756963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return ref.to_dict() May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:57:49.759898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application next(self.gen) May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application yield resource May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application next(self.gen) May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise self.value May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application session.commit() May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:57:49.760962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self.session.flush() May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application compat.raise_( May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:57:49.762082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:57:49.763106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application conn.query(q) May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application result.read() May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:57:49.764000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [parameters: {'id': 'c855f0d230174908b8a2ec2936a9d44b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:49.764861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 19:57:49.765857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:49.770655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 247/478] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:57:49 2022] POST /identity/v3/roles => generated 144 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:49.770777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:49.818117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:49.889832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccbf51-5ee2-4281-bf97-5275d1d2da03 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:49.928793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:49.929634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:49.929919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:49.930196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:49.941344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-e6c28756-27c9-4012-8280-8c2b90fe3908 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:49.949997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:49.951101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:49.952021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 232/479] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:49.957137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:50.105637 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718a4a4-a38d-4adb-b8f2-1e27a105c769 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:50.150801 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:50.151902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:50.152424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:50.152910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:50.153882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:50.154422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:50.156053 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac58562-b0a8-4a74-af5d-20def3719fcf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:50.170582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 248/480] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:51.322202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d39d-6824-417e-a37b-8f548bc15f8c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.322865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d39d-6824-417e-a37b-8f548bc15f8c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.322865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8d39d-6824-417e-a37b-8f548bc15f8c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.324517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 233/481] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:51.330056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.330512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.330610 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.349758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:51.352613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:51.377362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:51.441899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 249/482] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:51.488460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d39d-6824-417e-a37b-8f548bc15f8c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:51.604777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:51.610230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8d39d-6824-417e-a37b-8f548bc15f8c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:51.645580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:51.646404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.646710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.647003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.658111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-0028a2e5-1278-4d03-9ea7-4106e6fd79a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:51.671669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:51.672761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:51.673719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 234/483] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:51.679089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:51.688006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225076a6-39cc-4403-b5e1-049475b2067d None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.688298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225076a6-39cc-4403-b5e1-049475b2067d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.688581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225076a6-39cc-4403-b5e1-049475b2067d None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.690212 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 235/484] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:51.695349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.695633 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.695910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.723338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:51.724534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:51.834255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45c586-120c-47e6-a0e8-a6f73b801f6e None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:51.849451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 236/485] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:51.888266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:51.888953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:51.889237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:51.889511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:51.890272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:51.890674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:51.892158 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:51.906598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 250/486] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:51.911681 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:51.919745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:51.935137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.009048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.021988 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae5854-0d24-4e12-aece-3e7091c983cf None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.059843 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.060668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.060947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.061220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.073930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:52.082241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:52.083365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:52.084271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 237/487] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:52.089822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.121054 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155c59e-d9da-4a44-9a3a-05051f3031ba None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.191550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.192292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.192575 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.192851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.203514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d0c7d-7d9e-4bc1-8f59-04550f0ab6e0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.213581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.215145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.240217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.240907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.241188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.241462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.242229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:52.242540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.243970 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:52.244176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:52.245139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:52.246135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:52.246135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:52.246135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:52.246135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:52.251218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 251/488] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:52.253275 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 238/489] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:52.259008 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.259173 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.273251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.349378 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.397786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bd5a2-9508-4d2d-90a2-66936a32d1ec None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.398632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e42a2-88ad-48d7-8d35-7bd115d2c816 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.437133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.438028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.438152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.438363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.438588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.438793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.439147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.439374 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.440105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:52.440419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.442351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d084c-213d-455d-b5ff-654478ba2a30 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.450309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.452001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.456701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 252/490] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:52.458078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd66a-5fcb-4623-8594-484925df94a4 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.458366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd66a-5fcb-4623-8594-484925df94a4 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.458643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bd66a-5fcb-4623-8594-484925df94a4 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.460048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 253/491] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:52.461086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3111-b9f8-4041-89cf-1316813f269a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.461375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3111-b9f8-4041-89cf-1316813f269a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.461652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3111-b9f8-4041-89cf-1316813f269a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.466829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 254/492] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:52.468111 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3111-b9f8-4041-89cf-1316813f269a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8c4eb82f-99d3-4c7a-a4a1-1d691de74778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:52.478528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:52.479535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:52.480599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:52.480599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:52.480599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:52.480599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:52.481506 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 239/493] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:52.482807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b3be-4dbd-4a40-a1c8-23faa97e46b9 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.483098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b3be-4dbd-4a40-a1c8-23faa97e46b9 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.483373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b3be-4dbd-4a40-a1c8-23faa97e46b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.500853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-fd12b3be-4dbd-4a40-a1c8-23faa97e46b9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:52.502037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-fd12b3be-4dbd-4a40-a1c8-23faa97e46b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:52.559429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.576182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 240/494] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:52.576182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.576182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.576182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.590467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3111-b9f8-4041-89cf-1316813f269a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.602717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:52.603902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:52.617126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.635849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.636889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.637200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.637481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.644979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.646454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:52.662938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:52.663990 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 255/495] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:52.665019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.682731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 241/496] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:52.682731 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.776165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36555-cffb-43c7-ac17-a0632f47df0f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.798055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0d553-9ba5-4dd3-9a6e-2baf20d434b3 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.811739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.812417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.812708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.812983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.813718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:52.814035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.815475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:52.824536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.831622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 256/497] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:52.831622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.841892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.842735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.843026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.843300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.854452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:52.862343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:52.863544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:52.864494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:52.868485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 242/498] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:52.869341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:52.877960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:52.936488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3558f-b1fb-4cbb-8bd1-e575398f2316 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.971565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:52.972253 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:52.972542 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:52.972822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:52.973669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:52.973982 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:52.974314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470bb5-68b7-40c6-9530-bd9873115517 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:52.975462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.009422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.010231 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.010512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.010815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.016956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 257/499] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:53.016956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.027764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:53.035622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:53.036676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 243/500] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:53.037580 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.087767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.131190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b3c69-f328-4743-b7c0-2393d6230e07 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.132911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.153625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b1bc-9a90-4ddf-80db-6197342bb9bf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.168277 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.169098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.169387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.169663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] PATH_INFO: `/v3/users/glance` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.177125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.178612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.188741 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.189421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.189705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.189980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.190752 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:53.191063 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.192494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:53.194417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:53.195451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 258/501] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:53.196494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.211241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 244/502] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:53.211241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.304681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d889cce-a849-4269-a463-2592bbbce23e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.310717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19358d70-8e3b-4974-92e6-d51feafdb2cd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.313043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.338321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.339015 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.339353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.339635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.343526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.344203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.344488 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.344765 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.345509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:53.345820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.347264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.355673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 245/503] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:53.356465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.371818 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.416634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.418149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.461163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e4523-f699-4fa8-9c8e-76af76cbafe6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.496244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.496924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.497232 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.497533 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.498401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:53.498727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.500186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845ff11-8c2e-4834-9167-a86ac7731af0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.518631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 259/504] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:53.519499 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.536776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 246/505] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:53.538105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218ba7-07ce-4363-b91c-78a0a6e0504c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.538402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218ba7-07ce-4363-b91c-78a0a6e0504c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.538701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218ba7-07ce-4363-b91c-78a0a6e0504c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.539950 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 247/506] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:53.540643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218ba7-07ce-4363-b91c-78a0a6e0504c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.566055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.582771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.623221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863ed3-9eeb-4872-bc51-2ea47eca359f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.643507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218ba7-07ce-4363-b91c-78a0a6e0504c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.663236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.664028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.664319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.664584 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.675475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.677034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.680218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.680218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.680218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.680218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.695515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.697425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:53.698664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:53.699952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 260/507] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:53.700917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:53.718469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:53.719833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 248/508] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:53.721122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:53.801576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.810502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9bc41-3266-4412-b082-5598ee2dcdd7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.825750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:53.825899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6f596-a848-41f8-b8e5-485e50192918 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:53.848451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.849245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.849532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.849808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.860295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.861123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:53.861763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.861868 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.862051 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.862335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-6ce9ed89-2179-4434-a27b-5f31b0db9784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:53.879104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:53.880033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:53.881037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:53.881037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:53.881037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:53.881037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:53.881037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 261/509] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:53.881578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:53.881820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:53.882115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:53.899101 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:53.900297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:53.933990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:53.935477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:53.966006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 262/510] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:53.966858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.010409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.036061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 249/511] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:54.036897 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.085767 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.092556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dd514-92ae-44d8-b3ab-6f98de9c40c0 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.127954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.128742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.129014 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.129291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.130032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.130341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.131768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.143603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abd102-5d1b-45b9-821c-06afb5a6295d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.143766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 263/512] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.144414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.182869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.183667 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.183948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.184225 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.184946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.185252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.186637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.198056 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 250/513] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.199003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.234048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.250488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e6c3-6fc0-4d15-a439-47706bbea56f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.282919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.283623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.283900 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.284176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.284880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.285185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.286605 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.298182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 264/514] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.298650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423777b-6ca6-43a5-b2a8-07c75d43a36a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.298983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.318446 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.336091 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.336923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.337203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.337474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.348013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.349523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:54.367347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:54.368408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:54.369355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:54.369355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:54.369355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:54.369355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:54.369355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 251/515] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:54.369644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.406545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81a791-0941-42ee-9561-a363595734fd None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.442013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.442865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.443147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.443419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.453394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.454895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.465859 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:54.473200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:54.474372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 265/516] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:54.475617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.481189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117eb74-3337-419d-8e7f-8183af2d4cb0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.515505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.516318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.516602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.516877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.524273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.525735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:54.542335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:54.543473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 252/517] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:54.549365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.553693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.580531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21479f2b-721d-450c-8ce0-1e1e0c22b702 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.614360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.615136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.615425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.615700 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.622946 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.624417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:54.640531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:54.641735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 266/518] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:54.647686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.655550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423e90-f4e4-4e2d-bf1b-249b235a0c54 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.690704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.691691 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.692118 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.692501 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.699575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.701085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:57:54.716137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:54.717334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 253/519] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:54.718770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.728846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.744891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ddaef-e31e-44ae-9876-5dd5323f6ca6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.770668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.778456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.779171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.779461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.779752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.780712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.780836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.782193 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.793647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 267/520] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.794435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.817974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2096c-1e9c-4a24-9411-b1b019c04f5d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.851278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.852343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.852690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.853028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.853834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.854207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.855641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.867594 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 254/521] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.868317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.894219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb561098-e5d4-4edb-8103-e9dc372978b4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.926935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:54.927619 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:54.928149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:54.928149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:54.929005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:54.929316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:54.930790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:54.932345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:54.948403 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 268/522] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:54.949478 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:54.966799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbab82c-4e7b-49b6-8356-4f9cfa5fae06 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:54.994747 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.001422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.002110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.002395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.002672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.003541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:55.003856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.005332 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.022490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 255/523] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:55.023409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.055838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aab0db-3de4-42a9-9e6a-439c97a2a641 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.094064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.094764 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.095043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.095328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.096110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:55.096434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.097884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.115670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 269/524] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:55.116479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.126186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ee9c-b0ed-48da-975e-6e32942d90cb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.153281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.162505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.163222 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.163504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.163784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.164489 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.165960 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.186118 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 256/525] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:57:55 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:57:55.186937 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.230131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d6bf-83c2-4f63-bccd-c47260ea95bf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.238436 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.270244 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.271100 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.271380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.271713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.279710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.281204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:57:55.297960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:55.299056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:55.300006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 270/526] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:55.300539 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.311893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888b8fc-ee81-44d4-9704-0079b06a54e3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.351475 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.352466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.352750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.353024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.412006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.426770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4fad-d2e7-44f4-bfd2-0d127c87f1b1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.436587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.438832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.465991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.466780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.467066 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.467345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.502844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.544825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 257/527] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:55.545369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.545474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.545595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.632261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.652068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259a7-753d-455a-b30c-4d3193fec609 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.653152 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 271/528] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:55.654249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.691970 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.692701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.692989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.693266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.694090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:55.694454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.695965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.708991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 258/529] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:55.708991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.732042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.774118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540ce2-d7db-4c77-8301-649feec6206f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.823902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.824867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.825154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.825434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.826495 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:55.827220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.828721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.843641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbc913-729a-433b-a046-13ccc2a291c7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:55.846775 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 272/530] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:55.847792 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.884403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:55.885271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:55.885566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:55.885848 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:55.897570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:55.899994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:55.907945 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:55.922978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:55.924023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:55.924981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:55.924981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:55.924981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:55.924981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:55.928141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 259/531] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:55.929505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:55.981719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227b6f6-b749-4c2b-8017-a390531980d2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.009862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.019993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.020903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.021195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.021476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.033682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.035323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.039851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f170118-a225-48e4-86a7-efdf02f881a1 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:56.054202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:56.055252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:56.056213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:56.056213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:56.056213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:56.056213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:56.060300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 273/532] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:56.061213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.082332 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.083196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.083482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.083806 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.084655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=8485059a85954528b532ded08e87b2fd) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.084966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.086610 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.093324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 260/533] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:55 2022] GET /identity/v3/role_assignments?user.id=8485059a85954528b532ded08e87b2fd&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.094299 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.166916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.179376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e79de8-7a45-4082-bd00-95ad72fea903 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.213192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb5be4-f7c6-40ee-ab04-624ce8b4dd58 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.217505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.218187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.218474 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.218783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.219527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.219838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.221240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.240268 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 274/534] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.241550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.254500 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.255323 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.255608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.255886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.256718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.257032 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.258467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.271965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 261/535] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.286912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.293398 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.360881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b62e8-9775-448d-a406-0569b64dae95 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.399438 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.400462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.400812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.401161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.403083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ba47-d90b-4583-b67a-991cdb37f490 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.409686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.411488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:57:56.427386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:56.429649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:56.431185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:56.432111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.436959 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 275/536] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:56.436959 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.444417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.445281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.445569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.445900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.466096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.468258 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:57:56.484795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:56.486995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:56.488411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 262/537] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:56.494782 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.564313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.571379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af638-dd0a-4f84-b6b4-cb04ffbde65b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.623995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338d98c-7fbb-4d55-bc1f-a3de2f9fa691 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.651495 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.652318 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.652611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.652893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.653707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.654116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.655697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.671490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.672178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.672460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.672735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.673536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.673849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.676027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.686289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 276/538] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.691898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.698445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 263/539] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.707617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:56.798450 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:56.866429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd1a3a-4b3e-4491-8803-aac6f5d3a2b6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.907016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.907964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.908249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.908524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.909621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=f14d5698d8ef47f78ff8d447853af5ca) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.909938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.911420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e236f-1c1c-4faf-80fc-928cf28ab96a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.918380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 277/540] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/role_assignments?user.id=f14d5698d8ef47f78ff8d447853af5ca&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:56.936715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b594352-bbae-492c-a450-67529f8081ba None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:56.981977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:56.982776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:56.983106 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:56.983391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:56.984240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=de95d4bce1b742318f16a6be59eada28) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:56.984555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:56.986049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab0689-043f-41a6-84eb-469a460ec8b4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:56.993320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 264/541] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:57:56 2022] GET /identity/v3/role_assignments?user.id=de95d4bce1b742318f16a6be59eada28&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:57.671351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6974-50d1-4005-a4cd-09b09e43efa8 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:57.671913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6974-50d1-4005-a4cd-09b09e43efa8 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:57.671913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f6974-50d1-4005-a4cd-09b09e43efa8 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:57.673645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 278/542] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:57.679119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:57.679545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:57.679743 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:57.701746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:57.702992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:57.811787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 265/543] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 19:57:57.844338 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f6974-50d1-4005-a4cd-09b09e43efa8 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:57.892021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.007946 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f6974-50d1-4005-a4cd-09b09e43efa8 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.052729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.053949 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.054483 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.054997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.071536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:58.079631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:58.080733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:58.081749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:58.084253 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 279/544] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:58.090196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.162980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.245638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fcaed-6232-4672-ac7a-02d20cc084ba None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.288298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.288995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.289284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.289571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.290392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:58.290725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:58.292140 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b9e53-8ac2-422d-bf85-c57f803afd5e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:58.306116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 266/545] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:58.311449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.356264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863fff-180d-4fae-a19b-a9bd6c5ebbcb None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.356648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863fff-180d-4fae-a19b-a9bd6c5ebbcb None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.356862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61863fff-180d-4fae-a19b-a9bd6c5ebbcb None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.358727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 267/546] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:57:58.365750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.366018 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.366308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.395266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:58.396568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:58.424864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.441424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30301ca-048b-4ecc-b58a-2ab3dc670e78 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.487321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.488563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.489067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.489562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.510651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:58.513709 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:58.535438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 268/547] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:58.543953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:58.545007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:58.545974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:58.545974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:58.545974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:58.545974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:58.548549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 280/548] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:58.553835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.578936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.609838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.753350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089029d-1893-4253-832c-6c52a77893c5 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.755720 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde28d05-0621-4df1-910e-8c644a472667 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.804380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.805054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.805333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.805604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.806319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:58.806622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:58.808069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:58.820121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 269/549] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:58.825858 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.827006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.827847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.828126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.828402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.835050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.863731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:58.872075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:58.873075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:58.874071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:58.876900 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 281/550] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:58.883188 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:58.923564 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:58.937837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78657-1308-4b86-9d99-2620a75dc4a0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:58.972675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:58.973874 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:58.974372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:58.974892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:58.983660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:58.985446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:59.000372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:59.001455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:57:59.002474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:59.005235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 270/551] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:57:59.010842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.114256 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a6926-2697-407a-9080-db97d77e13d3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.124726 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321c1d2-9eac-4ca2-a600-637bcaffe908 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.150261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.151364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.151922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.152415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.153470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:59.153989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.155712 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0bb7-876d-4f8d-bc26-e1d5dcdb342a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.166892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.167263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.167553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.167830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.168583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:59.168889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.170267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.176754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 271/552] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:57:59.182587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413192e-a4e3-4e09-a076-cdab7ab3635c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.182766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 282/553] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:59.183727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413192e-a4e3-4e09-a076-cdab7ab3635c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.184228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413192e-a4e3-4e09-a076-cdab7ab3635c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.184503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.186257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 272/554] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:59.187217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413192e-a4e3-4e09-a076-cdab7ab3635c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.199579 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.255005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.307762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ac84-6419-4e08-92a4-a40bc5d06890 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.308774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413192e-a4e3-4e09-a076-cdab7ab3635c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.342426 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.343154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.343442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.343719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.349224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.350278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.350826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.351325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.362191 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.363996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-08180dc3-05a4-4c85-a633-f38ed296a923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:59.384822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:59.385954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:59.387085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:59.387085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:59.387085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:59.387085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:59.389726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 273/555] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:59.391385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.391896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.392390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.410491 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:59.412164 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:57:59.417781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.419328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.479238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.497168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 274/556] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:57:59.499679 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.514087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.566977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 283/557] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:57:59.568146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.642403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea0682-b5e2-44cc-a87f-a45d9d71cdac None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.690135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.690891 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.691176 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.691454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.692175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:57:59.692484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.694173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.705869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 275/558] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:57:59.706713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.722111 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ccc6-cc44-44f5-8fd8-2b41323fb0c3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.758796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.759690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.759961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.760386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.760386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.771226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-43b57e4d-c7e0-4047-8b1e-281d4c6513c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:57:59.779110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:59.780258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:59.781153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 284/559] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:59.782223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21688-8298-4e11-8e6f-1b82b697619c None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.782337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21688-8298-4e11-8e6f-1b82b697619c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.782633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21688-8298-4e11-8e6f-1b82b697619c None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.783928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 285/560] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:57:59.784488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21688-8298-4e11-8e6f-1b82b697619c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.803983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:57:59.830059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b51f87-ad69-486f-a221-2e70447772f5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.868974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.870183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.870676 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.871042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.882104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.883573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.896650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21688-8298-4e11-8e6f-1b82b697619c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:57:59.901890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:59.903158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 276/561] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:59.904125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:57:59.937789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:57:59.938599 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.938935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.939206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.946814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:57:59.948294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-32330a2a-f7e0-4b0d-8ff2-50cfe3228486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:57:59.962056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:57:59.963263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 286/562] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea9c09-b115-4906-8c92-2ae8156b2fd7 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:57:59.969124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea9c09-b115-4906-8c92-2ae8156b2fd7 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:57:59.969911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea9c09-b115-4906-8c92-2ae8156b2fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:57:59.984860 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-c5ea9c09-b115-4906-8c92-2ae8156b2fd7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:57:59.986051 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-c5ea9c09-b115-4906-8c92-2ae8156b2fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:00.004481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.007274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beddca-1ca8-4dc8-9972-a77ca273dc55 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.043000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.043686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.043971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.044249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.044999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.045311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.046726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.052556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 287/563] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:00.053865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77675-f877-4ef7-9f8b-949498ad4e90 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.054153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77675-f877-4ef7-9f8b-949498ad4e90 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.054428 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a77675-f877-4ef7-9f8b-949498ad4e90 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.055619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 277/564] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:57:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.055963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 288/565] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:00.056654 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77675-f877-4ef7-9f8b-949498ad4e90 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.056887 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.071728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.162160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8443-c9ea-42a8-be94-5359558e5acb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.164219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a77675-f877-4ef7-9f8b-949498ad4e90 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.195283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.195998 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.196290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.196565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.196798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.197281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.197469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.197576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.197747 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.198020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.198901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.199013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.199230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.200652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89db87a-5f11-4afe-9d25-52c15ea6b746 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.210591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 278/566] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.211399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.217464 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 289/567] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.218723 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.219005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.219276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.235617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:00.236824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:00.238935 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.296793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.305293 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 290/568] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:00.306108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.317762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a73a-bd78-4717-8cef-8656ba49105a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.351014 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.352135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.352415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.352684 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.362792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.364263 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:00.382022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:00.383267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 279/569] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:00.384408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.411227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebde869-8913-4432-917b-fb3c9e8cccef None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.444165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.444898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.445175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.445449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.456815 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:00.457255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:00.464681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:00.465867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 291/570] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:00.467249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.488095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579beb-dd36-449c-80b5-a449ff7192b2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.531367 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.536393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.537473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.537755 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.538079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.546017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.547517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:00.561772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:00.569851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 280/571] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:00.571029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.582819 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41193-8f6a-459f-8199-89a793b61eb1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.617160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.617953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.618221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.618505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.631704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.633187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:00.650525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:00.651776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:00.653041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:00.653041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:00.653041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:00.653041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:00.654833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 292/572] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:00.655890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.673345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bef59-ad40-4d18-8a7d-513a0621bea6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.706978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.707726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.708010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.708287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.710123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.719386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:00.727441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:00.728690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 281/573] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:00.729592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.755018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5765be-9d41-4a42-aebb-3d7966a8c34b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.761882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.788975 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.789644 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.789927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.790199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.790960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.791272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.792784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.804496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 293/574] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.805292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.830554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a810b-5fa9-4386-81a4-53a2f23160f5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.865347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.866044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.866335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.866616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.867400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.867714 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.869121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.882187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 282/575] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.882187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.914651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea5753-ef58-4ed8-836a-30eb7c844a89 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.935785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:00.947766 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:00.948461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:00.948740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:00.949017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:00.949809 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:00.950122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:00.951586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:00.963030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 294/576] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:00.963565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:00.986006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ceffb-c1ad-4da4-916f-8ed73ad53c5f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:00.990561 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.020438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.021106 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.021376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.021645 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.022369 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.022675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.024086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.036011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 283/577] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.036575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.061500 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f083985-29e3-4562-bcc6-3f8b982e642a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.098204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.098908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.099194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.099472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.100225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.100534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.102234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.110352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 295/578] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.111161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.141337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90c9-4e6f-46fd-b936-f737851930bb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.158057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.177001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.177806 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.178092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.178367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] PATH_INFO: `/v3/users/glance` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.186049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.187528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.197888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:01.201969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:01.203226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:58:01.204495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:01.207958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 284/579] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:01.208583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.211748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bd358-d9bc-4b89-978a-2204b9d058e6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.246357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.247118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.247404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.247696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.258191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.259779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:01.276604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:01.277718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 296/580] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:01.278722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.310919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf653123-a474-4362-a639-168f16ee1053 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.344434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.345089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.345371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.345644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.346471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=77bf036962a5438183f2a3fcf2e95312) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.346814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.348255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.353893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 285/581] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/role_assignments?user.id=77bf036962a5438183f2a3fcf2e95312&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.354922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.385735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c67b3-a4a4-4401-8516-ede7ab3ae2be None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.407136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.426884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.427708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.427988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.428262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.436109 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.437615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.440639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:01.455696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:01.456948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:01.458147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:01.458993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 297/582] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:01.459879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.482054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df05b8b-faaa-41e6-b162-11d2950126cf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.521053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.521783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.522067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.522335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.534807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.536296 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:01.555513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:01.556543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 286/583] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:01.557550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.574099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63c946-9e93-4133-a9dc-ab507e438f67 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.610651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.611360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.611658 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.611935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.612768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.613081 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.614524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.634845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 298/584] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.639857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.661788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.671561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb4d7d-7e28-45b3-9618-1c244a4b7227 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.701807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.706621 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.707366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.707653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.707925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.708727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.708958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.710360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.726278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 287/585] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.726278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.754362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa479d85-6345-49ef-9a17-ae1b1fb1c081 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.794156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.794905 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.795262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.795619 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.796430 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.796751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.798220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.810814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 299/586] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.811864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.833938 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c875562-744f-4cf6-92bd-0f63005f68b1 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.868956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.869627 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.869908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.870183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.870954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:01.871262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.872638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.884386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 288/587] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:01.889497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.904499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.922313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0378d86-14c6-4abe-af4b-23b61ad0bdd6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:01.940035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:01.958523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:01.959388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:01.959672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:01.959943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:01.970965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:01.972436 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:01.990033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:01.991065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 300/588] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:01.992041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:01.996224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26ba24-c304-431d-a44c-db7cadc85ffe None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.032725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.033932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.034221 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.034507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.042400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.043985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:02.058591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:02.059744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 289/589] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:02.060774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.111149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35f7-e18d-4e9d-962a-32753eb6427b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.134031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.147113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.148022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.148305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.148578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.164140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=a5b17626f37949c3adb553d9d4fb72fe, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.164604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa0b47-9876-4e82-a9f2-081b8c576433 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.165608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.179593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 301/590] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:01 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:02.187676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.204548 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.205383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.205665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.205955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.215003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.216495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.219492 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:02.233160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:02.234280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:58:02.235350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:02.239120 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 290/591] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:02.240110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.317970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a6f3-8cd6-4458-b20e-026ed37ab2ef None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.357551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.358586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53f7e-2201-40f3-965f-b021aed32b4a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.359074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.359570 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.360070 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.361093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:02.361663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.363375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.376931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 302/592] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:02.378124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.392355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.399081 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.399774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.400061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.400335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.401210 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:02.401595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.404151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.425579 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 291/593] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:02.426451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.480188 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.508874 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279d30-c8b2-49cb-aa76-7061d8b7f580 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.530558 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23faa3d-02dc-4c4e-a12d-222fa8d47f29 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.553706 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.555089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.555823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.556698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.558106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:02.558899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.561278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.567329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.568202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.568445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.568697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.581695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.581695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.586791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 303/594] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:02.587716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:02.599669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:02.600670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:02.601925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 292/595] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:02.604073 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.675162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.704235 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5930d-0534-4069-a28c-3ff57c5088e2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.730436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9986c6c-1ac3-45ce-86dd-0e69f1922dc0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.740355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.741461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.741958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.742439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.749675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.754479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.756333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.768526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.769343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.769628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.769907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:02.776554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:02.777525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:02.778476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:02.778476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:02.778476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:02.778476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:02.780767 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 304/596] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:02.781782 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.786239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.787284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:02.807287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:02.808340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:02.809292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:02.809292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:02.809292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:02.809292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:02.809292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 293/597] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:02.810038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.886307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccaae3-97f7-47d1-85d2-9994451e4f33 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.919838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbe0e9-97e9-45a7-9df7-f68d54f4a66f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:02.921371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:02.922549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.923513 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.924013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.924507 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.925496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:02.925974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.927623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.940617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 305/598] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:02.941745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.963163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:02.963844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:02.964260 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:02.964543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:02.965277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:02.965590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:02.967136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:02.985811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 294/599] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:02.986797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:02.997094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.049304 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a548-a252-47fd-863e-15cb8f6e5d32 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.084265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.085356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.085865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.086351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.087338 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:03.087863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.089663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.096783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f4562-2d44-41c1-8b5f-559233478c3c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.103466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 306/600] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:03.104609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.134933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.135866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.136150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.136484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/8485059a85954528b532ded08e87b2fd/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.153986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=8485059a85954528b532ded08e87b2fd, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.155502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.172584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 295/601] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:02 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/8485059a85954528b532ded08e87b2fd/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:03.173531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.192721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.289760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625d36c-7924-46ea-9913-c3444498d256 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.311994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64646d7e-e074-48a1-8224-dad75fd00d1a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.312956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.355790 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.357343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.357878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.358386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.367405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.369378 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:03.391654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:03.392674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:03.394088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 296/602] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:03.398476 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.402331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.403356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.403643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.403920 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.411537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.413104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:03.432608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:03.433787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:03.434871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 307/603] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:03.441132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.489484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.526853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5c984-a782-42bf-9204-befdb27443e2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.564538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.565272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.565561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.565836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.566638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:03.566984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.568582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.581807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 297/604] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:03.590328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eff2d0-28eb-48fb-bfc0-290db08b8037 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.596590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.626769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.627456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.627740 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.628026 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.628827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:03.629138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.630673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.657859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 308/605] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:03.664665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:03.707240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.758840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01a51-20c4-4fec-b804-db9f73b0e814 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.785760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468db79-d191-4326-9e3c-78c66413d6fb None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:03.797478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:03.805575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.806858 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.807910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.808400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/de95d4bce1b742318f16a6be59eada28/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.822769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:03.823795 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.824149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.824497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/f14d5698d8ef47f78ff8d447853af5ca/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.829719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=de95d4bce1b742318f16a6be59eada28, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.831418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fcc58-87c7-4d47-aadd-af2cbc228ad0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.841903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=f14d5698d8ef47f78ff8d447853af5ca, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:03.843551 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:03.849572 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 298/606] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:03 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/de95d4bce1b742318f16a6be59eada28/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:58:03.859030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f512-500b-453d-8c7f-b6feb0a01749 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.859384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f512-500b-453d-8c7f-b6feb0a01749 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.859603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107f512-500b-453d-8c7f-b6feb0a01749 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.864873 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 299/607] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:03.876525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:03.876891 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:03.877087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:03.877899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 309/608] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:03 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/f14d5698d8ef47f78ff8d447853af5ca/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:03.899412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:03.900808 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:03.998054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 300/609] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:04.031455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:04.126251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:04.151072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd989b68-300b-4d33-b2a8-c4aead566613 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:04.190765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:04.191585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.191870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.192145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.203816 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:04.211799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:04.212884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:04.213903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 310/610] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:04.218984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:04.347258 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a74f8-5d87-4f2a-9915-5715c2f4bee4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:04.362108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:04.384883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:04.385715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.386068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.386325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.387125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:04.387428 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:04.388833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:04.397603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 301/611] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:04.402870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:04.574125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a5b0-7f10-45a8-b475-ee399ab5c5f6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:04.620186 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:04.621027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.621307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.621578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.647170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:04.651653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:04.655144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-3fac9248-374c-49d0-8d4c-6e935caf0d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:04.677254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:04.678591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:04.679630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:04.679630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:04.679630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:04.679630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:04.679630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 311/612] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:04.685551 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:04.834651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149bfc-348b-4cbf-a794-56653f4dbf80 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:04.835391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefac-6ae0-4e21-afe2-bc50d7581e7f None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.835794 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefac-6ae0-4e21-afe2-bc50d7581e7f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.836077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefac-6ae0-4e21-afe2-bc50d7581e7f None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.837454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 312/613] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:04.844751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.844751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.844751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.877834 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:04.878986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:04.904952 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daa521-7661-4969-928c-9598bd75140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:04.906125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa521-7661-4969-928c-9598bd75140e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:04.906631 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa521-7661-4969-928c-9598bd75140e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:04.907156 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa521-7661-4969-928c-9598bd75140e None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:04.907931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daa521-7661-4969-928c-9598bd75140e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:04.908244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daa521-7661-4969-928c-9598bd75140e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:04.909784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daa521-7661-4969-928c-9598bd75140e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:04.929136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 302/614] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:04.938527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daa521-7661-4969-928c-9598bd75140e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.007101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.023386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 313/615] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:05.074033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.109336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daa521-7661-4969-928c-9598bd75140e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.184312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.185138 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.185424 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.185702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.199839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.201328 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.219401 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3bb8c-ac63-4996-996f-400d25cf2822 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:05.223096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:05.224128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:05.225177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:05.231245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 303/616] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:05.236520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.244306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.261072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.261893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.262175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.262448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.291599 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:05.302480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:05.303680 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:05.304627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 314/617] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:05.310001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.421993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e3b3-6f35-402f-ad0d-2c64f0a181ed None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.459933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.460555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.460843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.461118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.461901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:05.462207 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.463664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.472410 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.474635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 315/618] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:05.481216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.486177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4538e67-b373-419f-b0b4-ba231cec2263 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.529513 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.568369 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.569071 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.569361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.569641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.570493 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:05.570839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.572297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.590412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34814b8b-0847-4701-bb09-664148cef309 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.626327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.629903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.630021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 304/619] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:05.630106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.630106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.641226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.642831 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.643769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:05.662593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:05.663655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:05.664707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:05.664707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:05.664707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:05.664707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:05.664707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 316/620] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:05.669768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.787592 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.792968 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5c893-5df7-4320-8042-513e66c3260c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.793932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2a73b-12fe-40f8-922c-c0e4d8e94d4d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:05.831974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.832656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.832940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.833219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.833948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:05.834256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.835997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a438a38-ae97-4da8-8d5d-9805c7a1c476 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.838340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:05.839937 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.840455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.840947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.853476 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:05.853883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 317/621] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:05.855440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372576-6927-4ebb-885d-9ebbf9723cdf None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.855732 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372576-6927-4ebb-885d-9ebbf9723cdf None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.856013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372576-6927-4ebb-885d-9ebbf9723cdf None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.856239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:05.857777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 318/622] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:05.858509 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372576-6927-4ebb-885d-9ebbf9723cdf None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-bebcf99f-8ab8-4abb-a650-02b0029a6ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:05.879586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:05.880592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:05.881561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:05.881561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:05.881561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:05.881561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:05.884464 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 305/623] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:05.889706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:05.889706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:05.889706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:05.900238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:05.915733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:05.918088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:05.993986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372576-6927-4ebb-885d-9ebbf9723cdf None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.004443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 306/624] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:06.006037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.050020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.050926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.051215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.051495 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.061344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.063229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:06.082627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:06.084365 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:06.085389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:06.088039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 319/625] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:58:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:06.088039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.111960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.124632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67017cec-eea8-4922-ba07-b134d1fa6ce4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.170911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.171919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.172337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.172786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.174357 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:06.174673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.176104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.177634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.191777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 307/626] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:06.192712 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.214137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58604dae-8b9a-4042-aecf-c055952702db None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.260781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.262000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.262430 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.262862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.276267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:06.286061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:06.287389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:06.288302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:06.295507 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 320/627] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:06.295507 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.315816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e149-02ea-4a00-b034-c6dd7dd6b50f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.364392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.365312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.365452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.365682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.366538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:06.366878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.368339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.390981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 308/628] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:06.392276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.414657 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.444744 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226193-f58d-4cfd-8e74-e3652954a3b8 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.465075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.488855 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.490086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.490584 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.491116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.500581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.502876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.520302 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acba365-c617-440a-a4ea-0f9491dce4c6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:06.523282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:06.524272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:06.525358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 321/629] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:06.525903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.556990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.557702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.557984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.558266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.559042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:06.559350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.560721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e814a72-7b8c-43ac-b4c4-0b7f90c9f365 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.568971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 309/630] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:06.570154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265003-ac70-42b1-a994-ba9ace3eede2 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.570438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265003-ac70-42b1-a994-ba9ace3eede2 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.570735 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265003-ac70-42b1-a994-ba9ace3eede2 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.574983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 310/631] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:06.577692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265003-ac70-42b1-a994-ba9ace3eede2 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.642026 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1b20b-c22a-4b48-a3ae-4cfa50d199f0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.684834 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.685503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.685789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.686068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.689887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.704584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265003-ac70-42b1-a994-ba9ace3eede2 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.723510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.751449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.752305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.752426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.752693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.753545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:06.753786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.755279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.759855 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.761444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51160983-78b3-457b-9ee6-c1080fcf5476 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.768602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 311/632] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:06.770221 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.864392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 322/633] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:06.865663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87778-36ef-4a22-bf2e-749f63b580d6 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.865954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87778-36ef-4a22-bf2e-749f63b580d6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.866227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea87778-36ef-4a22-bf2e-749f63b580d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.872645 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ad458-0deb-4d2e-9ec1-be652bb7b033 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:06.881997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-5ea87778-36ef-4a22-bf2e-749f63b580d6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:06.883204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-5ea87778-36ef-4a22-bf2e-749f63b580d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:06.905355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:06.906162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.906444 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.906767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.912040 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:06.916755 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:06.918250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:06.936249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:06.937361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 312/634] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:06.938331 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.954333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 323/635] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:06.955569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389719-ff82-43e5-be3a-e3679ae178d0 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:06.955851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389719-ff82-43e5-be3a-e3679ae178d0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:06.956123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389719-ff82-43e5-be3a-e3679ae178d0 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:06.957372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 324/636] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:06.958048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389719-ff82-43e5-be3a-e3679ae178d0 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:06.977751 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.056148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6bb8a-7a08-43e5-87ac-eb6822a4f4bc None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.067857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389719-ff82-43e5-be3a-e3679ae178d0 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.091668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.092849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.093137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.093413 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/77bf036962a5438183f2a3fcf2e95312/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.102032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.102864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.103145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.103416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.108414 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=77bf036962a5438183f2a3fcf2e95312, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.109871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.113465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.115371 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.123190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 313/637] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:06 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/77bf036962a5438183f2a3fcf2e95312/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:07.124150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-303237f8-38a1-42f7-a890-334b8dc660a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:07.146506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:07.147622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:07.148579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:07.148579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:07.148579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:07.148579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:07.148579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 325/638] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:07.149927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.149927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.149927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.168396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:07.169626 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:07.186074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.215010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.244000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687461aa-15d4-4488-b75e-544b28b8aff6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.262729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 326/639] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:07.262729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.288990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.290100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.290583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.291255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.292116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:07.292881 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.294982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.310110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 314/640] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:07.310835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.374238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2267d75-6d4a-4688-a5ab-adedb8be35e5 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.409791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.410609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.410994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.411240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.420200 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febc1c9-de70-4074-a7c8-681d6b70eb84 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.421519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:07.429406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:07.430481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 327/641] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:07.436870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.447405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.462406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.463390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.464018 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.464452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.465439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:07.465765 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.467294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.469878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.483511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 315/642] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:07.484649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.549461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25799c-a340-416e-b120-4712b5b64e35 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.586333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.587182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.587470 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.587773 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.589536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65125068-3157-4c12-9a42-a57dd977d2cd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.599901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:07.609027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:07.610208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:07.611366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:07.613906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 328/643] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:07.615005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.641426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.642306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.642626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.642954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.650653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.652213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:07.667019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:07.668243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 316/644] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:07.673999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.696256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.730173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.732913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe31b-7817-440f-961f-07f8a9144cef None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.768449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.769128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.769420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.769690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.770440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:07.770778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.772163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.776515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d6e12-aef3-4e66-b18c-5a688f6e3744 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.780294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 329/645] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:07.781117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.813330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.814139 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.814424 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.814725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.823070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.824635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:07.840320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:07.841358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 317/646] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:07.842326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.898404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221592c-7ee5-4807-bd44-7b3e78fd50aa None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.930708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.938130 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.938853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.939144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.939431 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.940200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:07.940517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.941945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:07.949774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534080be-2221-40e3-b2bc-1c32b5ee680e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:07.950728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 330/647] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:07.951566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:07.972095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:07.992540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:07.993227 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:07.993511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:07.993785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:07.994626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:07.995004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:07.996648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.019284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 318/648] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:08.020287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.061445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd88a-59b7-472e-a8d6-33f7a1072fa1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.103242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.104143 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.104563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.104897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.116296 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.117762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.129648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758402e7-a5e9-416a-b4a0-df9176253840 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:08.135490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:08.136487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 331/649] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:08.138107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.170105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.170707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.170987 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.171284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.172079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:08.172389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.173824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.186940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.193298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 319/650] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:08.193298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.233499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.247215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca199c3a-0a1b-4195-8b49-e0dc3ab7abd0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.287290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.288487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.288776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.289444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.301645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.303768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.306522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd730a-7abd-40d2-8521-748848c912f2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:08.321833 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:08.322956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 332/651] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:08.324064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.345471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.346137 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.346425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.346727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.418610 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.420181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.426427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.433044 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd4b01-6a5d-4852-a15c-c9b6e2b7d4cf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.453822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.469932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.470613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.470926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.471209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.471945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:08.472240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.473607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.490519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 333/652] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:08.490519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.536344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 320/653] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:08.536344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.600129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c151-5ab0-4ee6-b830-be76cac6bf5b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.640308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2bf01-a8a9-40bb-9296-7075f7fb3cfb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.645399 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.646060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.646342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.646616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.647490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:08.647799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.649858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.666727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 334/654] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:08.666727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.689889 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.690648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.691294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.691756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.692042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.692784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:08.693096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.694516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.697757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.712246 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 321/655] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:08.713230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.798709 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090b56e-7ec9-49bc-91b1-d30f25703178 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.824045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52771394-8c8e-4690-b381-756f6d4b9a53 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:08.841065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.841838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.842125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.842405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.850891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.852708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.866102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:08.867448 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:08.867950 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:08.868467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:08.869104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:08.870159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 19:58:08.871243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:08.874783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 335/656] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:08.876136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.889442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:08.891131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:08.911367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:08.912417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 322/657] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:08.914936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:08.977166 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:08.996601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.021763 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53772c-3f72-43b9-a237-63ab1e1d6a9b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.057318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff2934-e4bb-470a-8562-8c636dfa376c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.064638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.065594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.065980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.066357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.076571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.078352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.097251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.098195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.098656 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.099114 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:09.099336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:09.100494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:09.102091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:09.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:09.103976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 336/658] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:09.104778 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.105080 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.106607 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.130307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 323/659] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 19:58:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:09.132762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.241986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee5c4a-77ce-475b-89be-2a77644a1622 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.268411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54ff7-a039-412b-aae9-8d7787554cc4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.271626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.282879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.283837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.284358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.284776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.285689 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:09.286147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.287829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.298808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.306753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 337/660] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:09.306753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.318707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.320003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.320437 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.320816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.322197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:09.322869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.324899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.354242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 324/661] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:09.354242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.434325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9725613-450d-4576-a097-cb7b61aa2eb0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.459230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ca9a-5db4-4c4b-bbb2-de18efd9daf4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.470086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.470760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.471046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.471330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.495125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.495968 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.496317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.496660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.503832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.505360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:09.519549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:09.520767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:09.521835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 325/662] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:09.522377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.548283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.550737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.555248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.557399 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a173c-bc7b-4b1b-b690-932c466de6ba None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.637131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4f8eb-acae-48a3-80be-df566d21a9bd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.676370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 338/663] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:09.676370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311e52-3bff-4034-bce0-390ec41e52ce None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.676370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311e52-3bff-4034-bce0-390ec41e52ce None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.676370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311e52-3bff-4034-bce0-390ec41e52ce None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.677723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.678387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.678674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.678975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.679749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 339/664] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:09.680466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d311e52-3bff-4034-bce0-390ec41e52ce None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.749839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.751376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4637e-d288-41a4-bd1d-f3fea0d16117 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.776074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.783896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:09.788667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d311e52-3bff-4034-bce0-390ec41e52ce None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.824892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:09.826198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.826198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.826198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.826930 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:09.827265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:09.828709 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:09.845305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 340/665] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:09.845305 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.864308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 326/666] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:09.865515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:09.865811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:09.866095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:09.882282 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:09.883519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:09.954263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7c02-0b10-4f4a-8582-a6d0675451ad None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:09.962862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 327/667] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:09.962862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:09.999988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.001054 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.001506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.001944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.013996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.015737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.018117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:10.034342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.035380 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 341/668] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.036353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.053967 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.074254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d869406-35e0-4494-966d-a9e5536e456f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.112417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.113083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.113374 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.113639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.114479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=8485059a85954528b532ded08e87b2fd) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:10.114830 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.116308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.130709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 328/669] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:09 2022] GET /identity/v3/role_assignments?user.id=8485059a85954528b532ded08e87b2fd&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:10.130709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.157460 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373b16-c2ce-4798-8c53-7bcfaa5b6ffa None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.208157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.209302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.209589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.210155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.226356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.228770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:10.254340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.255491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.256489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:10.256489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:10.256489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.256489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:10.257002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f077e-7234-443e-8662-0a2547bd1d7c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.258845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 342/670] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.260868 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.278479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.301615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.302454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.302769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.303051 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.315650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:10.324273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.325574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 329/671] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.326837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.352554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.403618 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a0dbd-76cc-4fc1-9563-587bd97f5d8c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.442925 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.443614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.443901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.444181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.444946 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:10.445215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.446626 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.457005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8098670-687e-4fbc-9aca-e9bb71512ce9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.460136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 343/672] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:10.460956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.502125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.503238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.503766 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.504208 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.505161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:10.505636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.507322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.521473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 330/673] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:10.522581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.563522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.597079 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe97612-bf3c-48a2-aafa-54f914576e8d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.630434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.645665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.646618 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.647139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.647571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.649153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00ab37-1f8c-4550-be8b-5a4820b80794 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.654728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:10.655282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.656958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.669635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 344/674] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:10.671434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.695500 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.697163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.697903 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.698382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.708706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.711421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:10.734405 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.735706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:10.736882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:10.740057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 331/675] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.741430 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.783832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4021b3-9805-4609-89ea-3db8cc99770e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.820363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.821374 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.821719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.822090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.829217 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.831060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:10.846252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.847536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:10.848762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:10.855004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 345/676] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.856389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:10.874350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.885490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ece1-584a-42d5-a505-d37616b1c677 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.908525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:10.933449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:10.934792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:10.936130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:10.936573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:10.951367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:10.953074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:10.967698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9ff9-2aae-4d1d-b166-0617bbda0039 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:10.976031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:10.977573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:10.978754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:10.978754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:10.978754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:10.978754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:10.981435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 332/677] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:10.983100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.017734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.019002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.019446 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.019911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.021547 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.022291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.024615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.040922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 346/678] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.042475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.102507 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340bfe-dfbf-4f84-be61-2b7e02268b4e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.143910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.144992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.145282 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.145564 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.146370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.146711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.148409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b67292-8dca-4008-b64d-e81eba27d461 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.150728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39085f9-1118-4c9e-a4cf-4083ea68f94f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.158053 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.162356 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 333/679] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.163716 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08a85-6d76-42f7-81bd-264222c28755 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.164007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08a85-6d76-42f7-81bd-264222c28755 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.164287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f08a85-6d76-42f7-81bd-264222c28755 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.169673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 334/680] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:11.169673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08a85-6d76-42f7-81bd-264222c28755 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.182976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.196831 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.197549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.197823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.198120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.198891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.199192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.200587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.212615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 347/681] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.213420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.283490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f08a85-6d76-42f7-81bd-264222c28755 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.318779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.319502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.319859 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.320206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.321556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=de95d4bce1b742318f16a6be59eada28) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.321876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.323521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15796d-7e4f-4e32-94b5-959bb3a0798f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.330473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 335/682] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/role_assignments?user.id=de95d4bce1b742318f16a6be59eada28&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.331818 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.332114 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.332394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.358812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4070a-4d73-477e-9ff9-14bf7cbca3b7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.362001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:11.364176 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:11.399376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.400445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.400985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.401528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.402604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=f14d5698d8ef47f78ff8d447853af5ca) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.403215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.405081 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.412540 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 348/683] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/role_assignments?user.id=f14d5698d8ef47f78ff8d447853af5ca&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.413829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.450153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 336/684] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:11.462433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.475936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.478922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.550544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea4fa8-553e-43cd-a786-c731c4fb4c1f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.594787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.595678 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.596169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.596738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.607771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.609609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:11.634714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:11.635906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:11.636928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 349/685] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:11.643506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.645553 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c156c-ba49-436d-9583-d0641761b0d4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.718316 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.719692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.720576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.721247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.734566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:11.743016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:11.744061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:11.745040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:11.747587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 337/686] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:11.754965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.762422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.779758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b5c67-73c5-4be3-8888-b817e861adaf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.837073 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.837779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.838383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.838774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.839910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.840226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.842414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.846569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:11.870014 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 350/687] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.878467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:11.901504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d54b18-b5f5-4c24-a153-8f4b7b7eb6fc None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:11.937639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:11.938361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:11.938642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:11.938970 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:11.939726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:11.940035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:11.941430 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:11.951181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 338/688] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:11.957070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.102213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71a59-3403-4506-8597-c49903eecf90 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.147512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bedc73-a006-4184-b442-83ea4bcf5c6b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.168158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:12.189272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.190767 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.191278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.191759 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.191880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.192639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.193005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.193290 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.215594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:12.222118 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.223632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:12.258697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:12.259725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:12.260795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:12.260795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:12.260795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:12.260795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:12.260795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 339/689] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:12.265707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.279973 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.281460 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.433580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 351/690] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 19:58:12.439773 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.470289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a765eb-c8fe-4155-a5d8-84a0c1dcd926 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.536514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.537509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.537965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.538395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.539323 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:12.539799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.541345 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.561269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:12.568958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 340/691] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:12.574930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.650334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:12.671061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681ab8e-3b93-487f-bb8a-5c3b84584e94 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.715928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.717036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.717036 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.717352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.728718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.736545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.745856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219bbf4-8630-4587-903d-883ebc47a51e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-b862ea63-e2a1-4629-99b8-87e478f97229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:12.759306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:12.760534 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:12.761765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:12.761765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:12.761765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:12.761765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:12.761765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 352/692] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:12.762114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dca3f-0254-444f-8660-4ee51640cd4a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.762406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dca3f-0254-444f-8660-4ee51640cd4a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.762710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dca3f-0254-444f-8660-4ee51640cd4a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.768245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 353/693] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:12.769160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dca3f-0254-444f-8660-4ee51640cd4a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.789033 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.790346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.790817 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.791271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.801205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.803553 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-52515816-83a8-4809-aeca-5b713efaecd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:12.821303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:12.822550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:12.823907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:12.826648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 341/694] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:12.828130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.828428 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.828990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.851965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:12.853931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:12.878731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:12.884457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dca3f-0254-444f-8660-4ee51640cd4a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:12.925995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:12.927279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:12.928197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:12.929008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:12.930135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:12.930941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:12.932727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:12.939042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 342/695] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:12.940093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.948375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 354/696] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:12.954016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:12.987492 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.076021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c1da-7371-4c36-9371-2e37631f15cf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.083581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093008d-2dc0-4027-8eb5-648d078f7bb0 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.119158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.119524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.119965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.120261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.120381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.120542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.120639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.120841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.121367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:13.121677 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.123149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.129097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.131101 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.145849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 343/697] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:13.146918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:13.147707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:13.148650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:13.149631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 355/698] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:13.150452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.183760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.239891 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.258246 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bce4-c9ed-490d-9055-269b7a8b1ac6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.283789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b419b83-100f-4ac6-a2f9-f06a9c84f32a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.322371 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.323445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.323884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.324331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.400263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.402324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.428945 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.429895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.430236 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.430659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.432162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.448155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.451531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:13.471641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:13.473337 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:13.474495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:13.474495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:13.474495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:13.474495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:13.476408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 344/699] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:13.477913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.529872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 356/700] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:13.531039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.591289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc44d3a-0fc4-4619-9e1a-b136f82d4a75 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.634799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.636117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.636896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.637418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.638432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:13.638993 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.640756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.644501 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.655369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248d81-21a0-49d8-ac60-7ec3c2c7b170 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.656088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 345/701] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:13.657286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.680111 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.698419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.699139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.699429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.699708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.700450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:13.700760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.702148 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.721527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 357/702] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:13.721527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.776450 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65fa8a-78da-4e3f-a755-d29561d0fbc6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.820628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.821824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.822334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.822878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.834768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.836766 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.843294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7307d-8d73-4cf3-913a-cc7f1d8ecae9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:13.856547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:13.859406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:13.860453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:13.860453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:13.860453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:13.860453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:13.861063 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 346/703] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:13.862364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.880240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:13.880918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:13.881204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:13.881480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:13.882332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=77bf036962a5438183f2a3fcf2e95312) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:13.882656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:13.884169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:13.891523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 358/704] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/role_assignments?user.id=77bf036962a5438183f2a3fcf2e95312&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:13.892431 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:13.924803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:13.946325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.014100 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc262a5-6b7e-44de-9a5b-87993a0e08ae None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.041067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b5e3-74e5-4fca-a000-20411318393e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.053013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.053703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.053991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.054325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.055102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:14.055412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.056802 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.070966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 359/705] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:14.076588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.123713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.124411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.124692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.124966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.125682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.127163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2922b-43ce-4454-8031-97dde64993a4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.151720 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 347/706] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:58:13 2022] POST /identity/v3/users => generated 254 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:14.153131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af341-67e0-459b-b88a-adec48dfadb0 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.153419 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af341-67e0-459b-b88a-adec48dfadb0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.153695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26af341-67e0-459b-b88a-adec48dfadb0 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.158223 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 348/707] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:14.166075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cbe5-fc69-445c-9cd7-f9158e390310 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.166352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cbe5-fc69-445c-9cd7-f9158e390310 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.166900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cbe5-fc69-445c-9cd7-f9158e390310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.185723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-8428cbe5-fc69-445c-9cd7-f9158e390310 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:14.186993 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-8428cbe5-fc69-445c-9cd7-f9158e390310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:14.212954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2457-e76d-4bee-b87a-e6089ff84d15 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.215856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.261026 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.262091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.262377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.262649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.272979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.274467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.275723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 349/708] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:14.276867 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7cdd-7dc9-4bca-a60a-2b668c543f33 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.277161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7cdd-7dc9-4bca-a60a-2b668c543f33 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.277441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7cdd-7dc9-4bca-a60a-2b668c543f33 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.282804 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 350/709] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:14.286079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.286403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.286709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:14.301752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:14.303265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:14.304332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.307230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 360/710] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:14.308049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:14.308738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.309298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:14.350467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.396655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 351/711] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:14.403542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.432223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7fcd-5048-4d89-9297-8dd6155ad6ee None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.477264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.478448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.478939 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.479514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] PATH_INFO: `/v3/services/network` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.480190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.481617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:14.496633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:14.497823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.498762 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 361/712] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:14.499662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.530041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.540514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d529e-35da-4700-80bd-1525dc41dbad None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.580789 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.581852 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.582446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.582926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.584000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:14.584504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.586142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.599810 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 352/713] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:14.606815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.622074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e599b2-1443-4779-976b-9f8cb8b6a367 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.647830 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.663287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.664758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.665237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.665675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.666922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.669171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:14.685650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:14.686969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:14.688105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:14.691190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 362/714] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:14.692150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.739611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab7cee-2454-4dcb-be13-99152ee1445b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.796376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.797602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.798078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.798521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.799606 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] RBAC: Adding query filter params (name=network) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:14.800076 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.801931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.808417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 353/715] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:14.809913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.810192 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.822064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b631-8c25-42e2-8345-18d393ec32d5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.857980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.858240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.858457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.858768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.859605 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:14.859919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.861358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.875121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 363/716] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:14.876116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:14.933846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:14.947768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110a910-f9cc-4aca-9f84-e694931aa93f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.986089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:14.987232 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:14.987727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:14.988229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:14.989145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:14.989682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:14.990535 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196acb-84a1-4aa3-a64b-7aa11304cebc None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:14.991596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:14.997584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 354/717] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:15.007852 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:15.030037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:15.030765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:15.031055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:15.031332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:15.032062 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] RBAC: Adding query filter params (type=network) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:15.032367 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:15.033779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c52e57-b4f8-4eff-8cca-ff3169ecadc3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:15.042867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 364/718] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:15.198599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca013-dbdb-4451-8e9e-63cf28100a80 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:15.241605 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:15.242296 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:15.242584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:15.242891 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:15.243616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:15.243929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:15.245386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc51144-6178-4eff-9200-7b2ffa292fec None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:15.252100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 355/719] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:16.597669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde100-1ab0-4d87-99f0-ada1e55458ed None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:16.598241 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde100-1ab0-4d87-99f0-ada1e55458ed None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:16.598241 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde100-1ab0-4d87-99f0-ada1e55458ed None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:16.599895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 365/720] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:16.605434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907252-17e5-4c62-8599-4cb0a659d369 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:16.605834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907252-17e5-4c62-8599-4cb0a659d369 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:16.606009 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8907252-17e5-4c62-8599-4cb0a659d369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:16.636210 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-d8907252-17e5-4c62-8599-4cb0a659d369 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:16.637458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-d8907252-17e5-4c62-8599-4cb0a659d369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:16.656473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:16.736521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 356/721] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:16.782586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde100-1ab0-4d87-99f0-ada1e55458ed None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:16.816306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:16.931183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde100-1ab0-4d87-99f0-ada1e55458ed None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:16.931426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d96e9-e0b4-4812-80bf-5b479ba561f0 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:16.931732 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d96e9-e0b4-4812-80bf-5b479ba561f0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:16.932020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d96e9-e0b4-4812-80bf-5b479ba561f0 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:16.938014 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 357/722] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:16.943674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:16.944239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:16.944757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:16.967014 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:16.968640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:16.974352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:16.975195 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:16.975476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:16.975750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:16.997664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:17.006963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:17.007974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:17.008901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 366/723] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:17.019416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.068110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 358/724] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:17.127774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.163022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.187153 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380857fb-91a9-413a-9375-c2b6e63530ec None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.223316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.224039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.224325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.224601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.225361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:17.225669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.227652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.241863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 367/725] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:17.243171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.277187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.329989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab5317-e96b-4aa5-8659-58b0be42e247 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.357857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced10e3-4c48-484d-96af-ca46575bd103 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.395009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.395823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.396108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.396386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.404251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.405072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.405354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.405628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.407823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.409302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.411099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.427658 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:17.428947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:17.429896 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:17.430898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:17.430898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:17.430898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:17.430898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:17.434858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 368/726] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:17.436165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:17.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:17.438459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:17.440532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 359/727] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:17.459599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.553866 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc98f-a697-487f-a63b-f7464ce442df None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.589935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.590617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.590932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.591211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.591948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:17.592258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.593647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.611668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 369/728] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:17.612989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.683776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.709773 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b95001-8174-458c-81ce-9c889f598fab None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.730284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d7b8c-d6bd-4a0d-9caf-46ddda3f3fa7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.745855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.746874 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.747385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.747829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.748834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:17.749409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.750969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3aac6-057f-4106-a6ac-b34265a63092 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.753708 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.762386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 360/729] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:17.764062 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731f8de-b4a2-46e5-84fe-8a2f23cd628e None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.764554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731f8de-b4a2-46e5-84fe-8a2f23cd628e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.765002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731f8de-b4a2-46e5-84fe-8a2f23cd628e None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.770752 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 361/730] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:17.771787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731f8de-b4a2-46e5-84fe-8a2f23cd628e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.774112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.774962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.775391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.775633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.783510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.785072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d877ff67-84f4-46d3-a268-0044069f2238 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:17.802034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:17.803468 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:17.804754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:17.808157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 370/731] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:17.809814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383de04-89b1-4803-af5d-472307367e4f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.810485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383de04-89b1-4803-af5d-472307367e4f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.810485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383de04-89b1-4803-af5d-472307367e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.829351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-9383de04-89b1-4803-af5d-472307367e4f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:17.831168 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-9383de04-89b1-4803-af5d-472307367e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:17.895060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731f8de-b4a2-46e5-84fe-8a2f23cd628e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:17.914853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 371/732] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:17.914853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383de04-89b1-4803-af5d-472307367e4f None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:17.951136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:17.952330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:17.952802 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:17.953238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:17.956966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:17.971147 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:17.973066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:17.992182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:17.993408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:17.994625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:17.994625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:17.994625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:17.994625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:18.000964 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 362/733] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:18.002023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.017303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383de04-89b1-4803-af5d-472307367e4f None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.053681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.054008 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.054385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.054884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.055249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.055817 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:18.056111 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.057684 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.075457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 372/734] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:58:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:18.076263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.105701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f27068-a8ed-4707-b8d4-f13d6739b663 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.138517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.139362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.139648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.139926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.150050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ee4a5ac7-d8d3-40e0-bfda-cab5780baa30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:18.157917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:18.159024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:18.159979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 363/735] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:18.160723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28079-83fd-4924-aaf2-a9e46f4c2f62 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.160723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28079-83fd-4924-aaf2-a9e46f4c2f62 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.161035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28079-83fd-4924-aaf2-a9e46f4c2f62 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.162242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 364/736] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:18.163377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897ca2-3f5a-4b26-a8f1-b275e74b626e None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.163756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897ca2-3f5a-4b26-a8f1-b275e74b626e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.164408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897ca2-3f5a-4b26-a8f1-b275e74b626e None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.165749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 365/737] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:18.166368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897ca2-3f5a-4b26-a8f1-b275e74b626e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.182077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd09a-9235-4dea-a427-b8a933e85c70 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.184000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.217382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.218052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.218330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.218608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.219358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:18.219661 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.221028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.233099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 373/738] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:18.233813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.274854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897ca2-3f5a-4b26-a8f1-b275e74b626e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.285147 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.309123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.309776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.310057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.310334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.332777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3063e9-3fe2-481d-b8b4-7d146da265ab None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.366989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.367671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.367930 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.368239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.368993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:18.369304 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.370731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbcdd4-b984-41f5-9fb7-404c5e527b84 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.377940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.378612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 374/739] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:18.379417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.379912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d7da-c2b3-4490-bba5-97f239c25d24 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.380209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d7da-c2b3-4490-bba5-97f239c25d24 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.380487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73d7da-c2b3-4490-bba5-97f239c25d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.396355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7f73d7da-c2b3-4490-bba5-97f239c25d24 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:18.397588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7f73d7da-c2b3-4490-bba5-97f239c25d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:18.414324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.465144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 375/740] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:18.466453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.466786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.467067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.485351 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 366/741] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 19:58:18.485351 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.485650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:18.485650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:18.496529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.552778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 376/742] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 19:58:18.553618 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.586053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb978fa6-38a6-4951-baa6-1c1dba6694a4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.622179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.623237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.623516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.623783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.631244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.632696 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.644207 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:18.649702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:18.650992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 367/743] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:18.652306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.664933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7127c-fa90-4c47-91fa-fe4bfb88be8c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.699642 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.700452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.700737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.701017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.711252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.712721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.719827 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:18.732150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:18.733174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 377/744] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:18.734166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.756786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ad109-51cb-4b32-8488-9e220ddf2ae3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.790322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.791163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.791443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.791744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.806207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.809934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:18.828088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:18.829240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:18.830238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:18.830238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:18.830238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:18.830238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:18.830238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 368/745] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:18.830577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.843047 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edae32-68e6-402a-9f19-908f61e424dc None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.877925 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.878597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.878908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.879185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.879913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.881370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:18.885184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.897392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 378/746] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:18 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:18.898221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:18.938028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ac971-88f8-44ff-a5be-9861062b21ee None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:18.965325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:18.992940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:18.994361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:18.995261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:18.995734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:18.996978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:18.999469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.022238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 369/747] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:18 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:19.022669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019960a-0f40-4b95-bd17-37072e49daf6 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.023583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.094532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.095291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.095637 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.095851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.097091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:19.098050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.099957 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.123272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 379/748] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:19.124234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.178528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159328c-688e-4588-8e74-61a4e19d8b3f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.193479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.222963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.224100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.224637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.225158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.226087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:19.226942 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.228527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.246814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 370/749] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:19.248066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.260578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa6700-6a6f-4c0f-a1fe-97c6ea845c36 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.299190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.302368 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.303361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.303801 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.304213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.305241 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:19.305807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.307611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.320109 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 380/750] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:19.321191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.376401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9c00c-f178-4a2d-a939-3d011f9fde6c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.410934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.411891 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.412338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.412764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.432465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ab277-e279-4057-ab68-4d49d57926de None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.444103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.470749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.471622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.471916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.472187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.481890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.483009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.484274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.485888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:19.498379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:19.499673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 381/751] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:19.500994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.529499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.592043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 371/752] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:58:19.593241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.613524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d46299-5aed-49b9-a1b1-fbbf762a70b5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.658611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.659609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.659989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.660364 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.670721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.672982 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:19.692842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:19.694071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:19.695147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:19.696081 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 382/753] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:19.696994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.716352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040672c2-e802-4776-9c61-74cb585fa6a4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.740296 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.765497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.766257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.766619 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.766989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.768421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:19.768804 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.770614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.782050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.798189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 372/754] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:19.799638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.819706 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a79ac-9d43-4e84-9a73-cdc8b071b42a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.856582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.857704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.858185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.858651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.870051 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.871954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:19.890579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:19.891574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:19.892510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:19.892510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:19.892510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:19.892510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:19.894790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 383/755] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:19.895861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:19.932976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40057e-5ce1-432e-9ff9-b0e2487806fe None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:19.974804 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:19.975838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:19.976352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:19.977161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:19.978206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:19.978759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:19.980715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:19.985226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:19.996024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 373/756] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:19.997304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.007675 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bddb7c-8447-4819-9d6b-d2e923ab2d71 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.044382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.045626 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.046113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.046585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.057623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.059811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.064965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:20.080057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:20.081050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:20.082042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:20.082042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:20.082042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:20.082042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:20.084338 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 384/757] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:20.085456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.119473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3da11-58ca-435a-a6c5-195c6519d26d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.159822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.161443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.162000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.162552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.163683 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:20.164217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.166649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.183045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 374/758] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:20.184230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.203776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9afe08-831d-4fb6-a4b4-c6469bb75a0b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.239266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.239947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.240248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.241011 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.241349 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=77bf036962a5438183f2a3fcf2e95312) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:20.241658 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.243272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.249905 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.250216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 385/759] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/role_assignments?user.id=77bf036962a5438183f2a3fcf2e95312&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:20.263191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.297535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c42ab5-273f-4840-95c5-358250ecac20 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.317702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.337983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.339187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.339724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.340218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.341181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:20.341736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.343400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.357413 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 375/760] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:20.364015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.510904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9281-0884-462d-a9bc-71c45ae154e8 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.515877 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6866bb-c74a-4fa2-b37b-f487aaf09d21 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.554718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.555568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.555855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.556133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.569829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.571348 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:20.593394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:20.594427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:20.595519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 376/761] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:20.604361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.605182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.605469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.605743 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.608347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.616320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.617796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:20.640523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:20.641476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:20.642876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 386/762] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:20.653253 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.672189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.727593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d38968-6e11-46d0-b4dc-cca276d3e605 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.763111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.763709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.763997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.764276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.765083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:20.765396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.766905 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.768745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.788183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 377/763] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:20.795205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.859313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ff11d-b75f-49e5-9bab-2f78952751c1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.924088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.924785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:20.925076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:20.925357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:20.926170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:20.926484 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:20.927971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:20.950513 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 387/764] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:20.955094 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:20.959690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:20.961168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4926e3-d1b8-4934-9135-041735f5994e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:20.998859 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:20.999921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.000218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.000497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.002602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=a5b17626f37949c3adb553d9d4fb72fe, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:21.004109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011b91f-55e9-4dd8-af48-6a83243654e5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:21.032108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 378/765] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:20 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:21.158360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418714-5029-4dd6-8693-946fb0609217 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:21.182582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:21.215632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:21.216340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.216621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.216893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.217750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=72e29083d38a4cb7a35ba84a21b33cee) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:21.218063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:21.219641 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e59b3-0a94-41c2-bea2-686958af694f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:21.226910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 388/766] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:20 2022] GET /identity/v3/role_assignments?user.id=72e29083d38a4cb7a35ba84a21b33cee&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:21.324283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220a71-f46e-4b68-8bdf-f7dd03e672ce None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.325000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220a71-f46e-4b68-8bdf-f7dd03e672ce None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.325508 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220a71-f46e-4b68-8bdf-f7dd03e672ce None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.327183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 379/767] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:21.333113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93b579-15d4-45f9-86e7-0690608a1e2d None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.333481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93b579-15d4-45f9-86e7-0690608a1e2d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.333704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93b579-15d4-45f9-86e7-0690608a1e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.356889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7c93b579-15d4-45f9-86e7-0690608a1e2d None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:21.358159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7c93b579-15d4-45f9-86e7-0690608a1e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:21.434869 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 389/768] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:21.469853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f220a71-f46e-4b68-8bdf-f7dd03e672ce None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:21.549078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac4f0-d180-4504-9ad1-e70cf986dd32 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.549532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac4f0-d180-4504-9ad1-e70cf986dd32 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.549911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac4f0-d180-4504-9ad1-e70cf986dd32 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.552807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 390/769] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:21.557862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.558266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.558879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.581890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:21.583170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:21.602718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f220a71-f46e-4b68-8bdf-f7dd03e672ce None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:21.667807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:21.668636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.668920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.669193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.669865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:21.671351 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:21.690113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 391/770] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:21.701340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:21.702435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:21.703436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:21.704247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 380/771] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:21 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:21.708470 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:21.753734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:21.777751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:21.807104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:21.838085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7045f33-f5b1-48cb-b403-a07e8f87af26 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:21.878417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:21.879145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:21.879433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:21.879713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:21.880444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:21.880758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:21.882156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:21.894895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 392/772] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:21.903668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:21.980239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66981033-c50f-491c-8007-bc633c84ecc4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.055178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.056439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.057008 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.057554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.058435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.060063 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.066708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d371b-1a47-436a-b281-f9f24132c3e9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.073570 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:22.084090 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:22.085149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:22.086145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 381/773] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:58:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:22.098385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.132010 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.132701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.132985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.133258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.133981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] RBAC: Adding query filter params (type=network) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:22.134284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.135832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.150473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 393/774] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:22.167734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.225191 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d3702-acfc-4fdb-ba6c-21ee9ba87370 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.231042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:22.296601 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.297321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.297612 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.297893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.298623 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:22.300692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.302096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.314577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 382/775] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:22.319692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.329403 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6036-e240-42c1-9b7e-55bef5d2837b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.373050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.373988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.374271 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.374543 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.375370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] RBAC: Adding query filter params (interface=public, service_id=7ea17eefa61e48a384f60d6b6ee2adae, region_id=RegionOne) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:22.375682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.377066 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.397647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 394/776] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/endpoints?service_id=7ea17eefa61e48a384f60d6b6ee2adae&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:22.398511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.438085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:22.507150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6993-7fca-4008-899c-955d9d9ad0de None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.542481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.543622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.544116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.544698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.545722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.547517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.554145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 395/777] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:22.579327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef863-13e8-49d0-ba8a-afc8d69f7e60 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.620973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.622173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.622668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.623257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.624204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:22.624736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.626376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.637183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 383/778] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:22.640466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.791063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:22.794433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db035d-e06b-417b-8eb8-bca09eee19fe None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.832103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.832826 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.833112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.833386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.834181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] RBAC: Adding query filter params (interface=public, service_id=61530f5d169f49e0b5af176c17f87571, region_id=RegionOne) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:22.834494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:22.835916 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c364bf-9e60-4d5d-a45c-05e87804da6c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:22.845541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 396/779] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/endpoints?service_id=61530f5d169f49e0b5af176c17f87571&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:22.847537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:22.863944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:22.947580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0eb9-9684-4b3f-adce-096da70eca5b None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.947994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0eb9-9684-4b3f-adce-096da70eca5b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.948276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0eb9-9684-4b3f-adce-096da70eca5b None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.949828 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 397/780] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:22.954838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.955137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:22.955422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:22.956438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810397-46c9-4c79-82c9-8a31edb35b03 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:22.975129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:22.976335 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:22.998849 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:22.999526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:22.999809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.000085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.001201 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:23.002746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:23.010273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 384/781] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:22 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:23.054639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 398/782] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:23.077884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:23.198103 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:23.235373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc9a0-7696-4257-9ba8-0fbafc8ebd13 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:23.276158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:23.276983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.277266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.277545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.295652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:23.303690 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:23.304721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:23.305625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 385/783] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:23.311355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:23.427201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:23.436606 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718366-bff6-4aa5-8c7f-b99ca1c9e672 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:23.483565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:23.484164 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.484453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.484728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.485494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:23.485804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:23.487232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:23.501669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 399/784] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:23.507051 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:23.656924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab51d9-9215-4d83-88ae-fffc9ce3b197 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:23.708468 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:23.709286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.709569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.709853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.717186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:23.727276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:23.728755 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-48195843-88a4-48db-8e65-5ddd48aa0f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:23.755113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:23.756129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:23.757195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:23.757195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:23.757195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:23.757195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:23.757195 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 386/785] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:23.762899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:23.894353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85273274-3bf6-403d-9740-46e107d51e8e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:23.906517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883bbb-eb04-4368-8097-e9a43844c9cf None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.907113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883bbb-eb04-4368-8097-e9a43844c9cf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.907113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31883bbb-eb04-4368-8097-e9a43844c9cf None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.909542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 387/786] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:23.913494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e55f-141c-4e77-9c0a-cef8929f430e None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.913779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e55f-141c-4e77-9c0a-cef8929f430e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.914058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04e55f-141c-4e77-9c0a-cef8929f430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.941523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-5c04e55f-141c-4e77-9c0a-cef8929f430e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:23.942748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-5c04e55f-141c-4e77-9c0a-cef8929f430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:23.946245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:23.946956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:23.947242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:23.947521 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:23.948347 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:23.948659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:23.950051 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:23.968612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 400/787] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:23.974270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:23.990970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.048458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 388/788] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:24.050471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1eec-89df-4af9-be18-4946b2d39b2c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.050962 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1eec-89df-4af9-be18-4946b2d39b2c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.052255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1eec-89df-4af9-be18-4946b2d39b2c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.053982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 389/789] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:24.062403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.062403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.062403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.086311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:24.087526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:24.093745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062eba-a37b-42c8-a22c-b17f3c823c1c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.131102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.131951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.132316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.132610 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.140670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.142409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:24.158063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.159323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 401/790] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:24.160952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.166895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 390/791] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:24.167776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.241578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.260964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.293055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bff4d6-816a-482b-b991-0628365186a7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.302622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8725cb-fd62-4fef-b1e3-151f96ffc3ac None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.330817 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.332454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.332895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.333324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.339294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.340109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.340512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.340887 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.341840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:24.342257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.343940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.346412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:24.356903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.358145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:24.359303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:24.361443 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 402/792] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:24.362935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.370988 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 391/793] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:24.370988 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.474899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b243c6f-2b28-4f98-afc4-490036d12e3a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.480420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e6f7-f0f4-4399-a973-428f6e2b3c0a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.488467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.512725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.513595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.513884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.514215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.516511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.522498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.523503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.524111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.524595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.525602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:24.526170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.527788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.527918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:24.536255 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.537322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:24.538221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:24.540243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 392/795] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:24.541457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.542475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 403/795] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:24.543359 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.651778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1e8d4-933e-4118-a058-495908dd6461 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.662111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0ad1a-908f-48d0-99ab-d5c9e22413d4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.690379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.691086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.691369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.691641 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.692387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:24.692690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.694075 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.707620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 404/796] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:24.707620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.709976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.711072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.711457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.711886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.724695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.726229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:24.745947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.747035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.748041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:24.748041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:24.748041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.748041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:24.754451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 393/797] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:24.755561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.778624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.781702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:24.838321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6759f43-cd71-46fe-b531-fa6c1ab92f9b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.867400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893621-202b-4de5-b0c2-9baa562fedfa None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:24.886147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.886919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.887209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.887492 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.902134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.903748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.905587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:24.906723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:24.907648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:24.908142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:24.920287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:24.922096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:24.924319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.925283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.926288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:24.926288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:24.926288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.926288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:24.926288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 405/798] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:24.927039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:24.943940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:24.944972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:24.945955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:24.945955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:24.945955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:24.945955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:24.948330 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 394/799] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:24.949388 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.034867 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.050960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89494604-9a7b-444d-ab07-8ebe16f5100a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.061160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.068441 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b964d-f705-48ee-8800-54f499f47081 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.090361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.091381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.091914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.092363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.093344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.093830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.095566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.104248 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.105152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.105324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.105705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.106512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.106918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.108360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.111879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 406/800] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.113093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.126427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 395/801] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.127550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.223179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977709c-be27-49f1-88ea-11af72235f1b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.232596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f36e73-71b5-4975-9b54-67076a8ad6d6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.269331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.269331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.269331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.269331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.271485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.271485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.271485 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.271929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.278437 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.279278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.279561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.279831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.287101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.292642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.292805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 407/802] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.292805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:25.307890 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:25.309199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:25.310432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:25.316647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 396/803] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:25.317650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.328928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.410900 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b775-c4bf-4e8e-8f1f-f9a10cd07882 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.429315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca395eb-6c1f-4556-9aa6-561a14d7e4b5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.449137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.449971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.450259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.450535 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.458537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.460061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.467164 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.467974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.468262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.468539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:25.474909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:25.475971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:25.477334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 408/804] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:25.477973 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.482255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.483492 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-4706ebee-7858-49d8-99a5-9faf59419932 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:25.498267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:25.499383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:25.500429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:25.504155 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 397/805] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:25.505510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b9f1-2ee3-4a95-8c91-148a8c9b6f24 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.505768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b9f1-2ee3-4a95-8c91-148a8c9b6f24 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.506049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b9f1-2ee3-4a95-8c91-148a8c9b6f24 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.507504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 398/806] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:25.508070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40b9f1-2ee3-4a95-8c91-148a8c9b6f24 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.567269 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.576024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.589415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668281d2-e437-4156-80ec-1f7e105e77ad None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.616929 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40b9f1-2ee3-4a95-8c91-148a8c9b6f24 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.623472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.624154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.624442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.624718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.625519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.625836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.627341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.639609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 409/807] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.640408 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.652628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.653311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.653601 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.653877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.654750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.655069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.656516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9bfb-a8d5-4bdd-a0ae-a0bdf5f5f4e5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.673593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 399/808] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.675054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7989-1651-47ef-bf3c-d710c95a18e9 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.675341 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7989-1651-47ef-bf3c-d710c95a18e9 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.675620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac7989-1651-47ef-bf3c-d710c95a18e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.691595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-5bac7989-1651-47ef-bf3c-d710c95a18e9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:25.692793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-5bac7989-1651-47ef-bf3c-d710c95a18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:25.741806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c9da5-e73f-4ddb-b915-76d973f29eb9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.757208 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 400/809] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:25.758516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770307e5-f6d3-4ff3-9735-ccc547457c9f None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.758838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770307e5-f6d3-4ff3-9735-ccc547457c9f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.759117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770307e5-f6d3-4ff3-9735-ccc547457c9f None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.760453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 401/810] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:25.761209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770307e5-f6d3-4ff3-9735-ccc547457c9f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.785471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.786157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.786475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.786778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.787612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:25.787926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.789390 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.806625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 410/811] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:25.807512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:25.813697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.817057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:25.874243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770307e5-f6d3-4ff3-9735-ccc547457c9f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.906501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05058732-0702-4f41-b5b2-456a8c1d1529 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:25.907896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.908794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.909077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.909351 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/77bf036962a5438183f2a3fcf2e95312/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.911319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=77bf036962a5438183f2a3fcf2e95312, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.912768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bc702-f098-4f7f-8c21-b9d5effb3a1f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.926449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 402/812] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:25 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/77bf036962a5438183f2a3fcf2e95312/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:25.927717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.928012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.928292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.946665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:25.947993 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:25.958440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:25.959786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:25.960092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:25.960358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:25.974654 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:25.976175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:25.995777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:25.996864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 411/813] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:26.003394 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.029335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 403/814] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:26.038984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.073667 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.077287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.127790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786ab37-89e2-4cd0-9c7a-c1045f98cb27 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.157678 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55bd1-f152-4b76-807d-199cb23ac320 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.164043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.164973 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.165259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.165536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] PATH_INFO: `/v3/services/network` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.166194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.167778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:26.180137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:26.181201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.182307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 412/815] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:25 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:26.183194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.197823 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.198566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.198879 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.199154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.267689 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.269253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.297755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21691f-e82b-4bcb-baf7-2ec9f196dbed None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.301402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.322801 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.337337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.338102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.338522 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.338840 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.339569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:26.339874 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.341261 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.354007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 413/816] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:26.354960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.382272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 404/817] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:58:26.383159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.469897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b04630-c9ac-4d9d-a988-69a956c8aa8d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.491078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c688d-2426-4ff0-ae28-b20a522b6781 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.510313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.511177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.511494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.511779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.512540 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.513780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.521814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:26.527108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:26.528341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.529682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 414/818] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:26.531668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.532455 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.532853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.533502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.534051 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.534446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] RBAC: Adding query filter params (name=network) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:26.534883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.536310 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.546734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 405/819] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:26.546734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.587414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.650523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508adae-26b5-4f8d-a9fd-b384cc2f03b1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.654984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaad901-bfda-498c-bc41-ccf69821ab85 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.687366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.688169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.688448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.688720 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.692559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.693508 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.693894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.694262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.695497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.696960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.705342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.706813 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:26.713454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:26.714624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:26.716030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 415/820] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:26.717865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:26.729380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:26.730573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:26.732218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:26.732218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:26.732218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:26.732218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:26.732218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 406/821] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:26.734084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.785180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.844116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a4f-9f8b-4f91-a250-d44088ead10b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.845244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc7bd6-c990-4b70-bd58-d25feea34913 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.853023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:26.881145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.881583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:26.881830 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.882117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.882302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:26.882406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.882587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:26.882850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:26.883186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] RBAC: Adding query filter params (type=network) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:26.883499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.883597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:26.883874 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:26.884922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.885354 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:26.890206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 416/822] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:26.895769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 407/823] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:26.895769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.896001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:26.998950 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ddf8-1e88-4af5-991d-85c3207d0b62 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:26.999516 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e059e3-029d-4e0e-944b-1ee87e097b07 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.010934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.036522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.036771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.037125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.037415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.037529 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.037698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.037889 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.037972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.038497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:27.038803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:27.038908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.039119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.040312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.040588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.058783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 417/824] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:27.058783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.059095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 408/825] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:27.059542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.088942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.166014 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da25ea-b207-445e-942d-5f35dc23e2ac None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.170187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040909b-a930-462f-851e-8dff0ad6b205 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.201798 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.202895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.203392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.203878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.204844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.205450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.206125 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.206409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.206700 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.207423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:27.207705 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.207812 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.209085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.214760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 418/826] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 19:58:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:27.215544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.236739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 409/827] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:27.238102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.277077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.350477 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.362442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d01d-96cf-4226-ad8b-2694f0c94aea None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.379539 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19dd2-359c-4bce-ba2a-c499c7e00ac2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.412748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.413579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.413862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.414135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.424278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.425761 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.432615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.434284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.434861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.435357 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/72e29083d38a4cb7a35ba84a21b33cee/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:27.442780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:27.443774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 419/828] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:27.445381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.459870 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=72e29083d38a4cb7a35ba84a21b33cee, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.462180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.488885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 410/829] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:27 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/72e29083d38a4cb7a35ba84a21b33cee/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:58:27.488885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.563722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bfd28-e6d0-4d20-b829-0037d4e674d1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.581190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.602209 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.602836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.603122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.603399 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.604226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.605656 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.622634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920484-548a-427d-9998-2d68b15b8a65 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.642499 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 420/830] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:27.678862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.679562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.679846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.680121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.680943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:27.681259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.682875 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ccb2-b011-4f5f-8dc3-25b195768188 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.698082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 411/831] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:27.704306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:27.720229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:27.835287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeba08-b474-4617-810c-c30a0dfcffb7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:27.871346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:27.871941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:27.872224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:27.872506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:27.873350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:27.873664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:27.875161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ed28e-63a8-4da0-834f-549b94a92df9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:27.881848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 421/832] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:27 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:28.205419 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19febd2-de62-493a-ba3a-e7413db128a3 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:28.205961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19febd2-de62-493a-ba3a-e7413db128a3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:28.205961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19febd2-de62-493a-ba3a-e7413db128a3 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:28.207597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 412/833] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:28.213129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:28.213559 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:28.213738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:28.231416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:28.232598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:28.304831 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 422/834] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:28.328692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19febd2-de62-493a-ba3a-e7413db128a3 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:28.446184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19febd2-de62-493a-ba3a-e7413db128a3 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:28.475533 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:28.484235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:28.485044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:28.485327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:28.485603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:28.496649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:28.504353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:28.505467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:28.506837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 413/835] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:28.511578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:28.515790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:28.620287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602f8e5-ecd8-4365-96c0-d62fe6ccbae6 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:28.658175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:28.659242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:28.659778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:28.660277 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:28.661239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:28.661778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:28.663423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:28.672894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 423/836] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:28.678298 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:28.788421 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabc890-7f33-4015-b61d-a1f473a275ac None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:28.824939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:28.825742 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:28.826027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:28.826297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:28.837524 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:28.839156 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:28.856980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:28.858005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:28.859596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:28.859596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:28.859596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:28.859596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:28.859596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 414/837] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:28.864102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:28.933419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:28.975090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf946-1b25-4175-b89f-f7cd36b9c8af None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:29.010863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:29.011940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.012455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.012985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.013937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:29.014472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:29.016112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:29.029217 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 424/838] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:29.034385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:29.079701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:29.143367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443dc1-2ac5-4347-a180-72f24e9a9091 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:29.178577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:29.179677 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.180141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.180565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.188906 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:29.190723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:29.205646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:29.207418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 19:58:29.208704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:29.211110 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 415/839] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:29.217280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:29.321254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539fd2a-1551-4e2d-914d-8169b4f16033 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:29.347907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:29.358352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:29.359343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.359821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.360275 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.361350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:29.361848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:29.363537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:29.382372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 425/840] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:29.388058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:29.491295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:29.495261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a06713-4ba9-43b6-b821-c1ae4d02bc3b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:29.531597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:29.532270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.532563 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.532844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.604596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:29.605986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b11c-0154-40ce-9fe0-bb1543f39065 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:29.712049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:29.717833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 416/841] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:58:29.723407 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:29.833599 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6064d23-5c6a-42c8-8fcd-bb03d1226063 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:29.858843 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dec90-f627-4445-9f5c-e0faf89762cb None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.859393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dec90-f627-4445-9f5c-e0faf89762cb None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.859684 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dec90-f627-4445-9f5c-e0faf89762cb None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.861809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 417/842] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:29.867650 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.867945 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.868229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.870873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:29.871686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:29.871972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:29.872251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:29.884889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:29.886206 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:29.886435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:29.887574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:29.910140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:29.911250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:29.912227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:29.912227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:29.912227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:29.912227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:29.912227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 426/843] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:29.919830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:29.969921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:29.970916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 418/844] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:29.988287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.056060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9a3f5-ef88-40ca-afa9-03a71e632d38 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.092883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.093564 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.093849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.094127 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.094996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:30.095202 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.096595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.113996 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 427/845] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:30.114856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.115945 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b549ea-93a5-4d93-b8b0-790b04e2e109 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.146609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.152952 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.153763 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.154042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.154308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.164677 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b03e985d-61a8-481e-a8c9-4b264cd8bfd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:30.172534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:30.173576 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:30.174497 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 419/846] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 19:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:30.175923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44197dc-3a29-4db7-bdea-20b2a4578d5e None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.175923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44197dc-3a29-4db7-bdea-20b2a4578d5e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.175923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44197dc-3a29-4db7-bdea-20b2a4578d5e None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.176932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 420/847] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:30.179632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44197dc-3a29-4db7-bdea-20b2a4578d5e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.219233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.226240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2956-a1cc-4bf8-a219-03efe4e49a4a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.260377 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.261182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.261467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.261742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.269448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.270940 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.281486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44197dc-3a29-4db7-bdea-20b2a4578d5e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-9762c578-78e5-40f6-979f-5adc22197261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:30.285112 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:30.286254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:30.287310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 428/848] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:30.287955 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.288344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.288613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.305470 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:30.306667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:30.318803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.319491 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.319778 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.320057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.320831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:30.321129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.322567 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0983388-d042-46cc-aef9-f33725edd8b7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.331150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 421/849] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:30.332212 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064c5a-f7ce-4772-ad54-eb9f36e6a252 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.332505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064c5a-f7ce-4772-ad54-eb9f36e6a252 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.332802 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44064c5a-f7ce-4772-ad54-eb9f36e6a252 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.334131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 422/850] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:30.336284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064c5a-f7ce-4772-ad54-eb9f36e6a252 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.375078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 429/851] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:30.376229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.397984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.451390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44064c5a-f7ce-4772-ad54-eb9f36e6a252 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.464276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.479824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ad4e5-73ea-4261-a572-51a3d6be5027 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.486827 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae36246-d561-4cd6-8128-10407656719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.487485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36246-d561-4cd6-8128-10407656719d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.487772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36246-d561-4cd6-8128-10407656719d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.488049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae36246-d561-4cd6-8128-10407656719d None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.488836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36246-d561-4cd6-8128-10407656719d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:30.489152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36246-d561-4cd6-8128-10407656719d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.490599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae36246-d561-4cd6-8128-10407656719d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.505077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 423/852] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:30.506309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.506614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.506930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.519243 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.520038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.520324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.520601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.523320 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:30.524502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:30.531037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.532505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:30.550177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:30.551360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 430/853] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:30.552673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.596240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 424/854] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:30.597064 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.651642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.654482 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c8441-27fb-4e95-931e-9dee759fa531 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.688350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.689156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.689440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.689717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.690378 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.691805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:30.703582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:30.704779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:30.705710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 431/855] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:30.706596 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.711075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286261-fc5f-4b22-b863-191bfee352c7 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.712140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.750575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.751268 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.751552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.751826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.752665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=77bf036962a5438183f2a3fcf2e95312) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:30.752978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.754436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.760568 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 425/856] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/role_assignments?user.id=77bf036962a5438183f2a3fcf2e95312&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:30.761340 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.844282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854709d-595b-4ce2-9957-568818fae28b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.881339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d810076-da40-45ac-bc59-a7a34e14097c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:30.882389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.883115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.883405 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.883692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.884441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:30.884758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.886219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.891065 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:30.899699 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 432/857] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:30.900701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.928201 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:30.929170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:30.929456 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:30.929724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:30.930403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:30.932045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:30.945354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:30.946487 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:30.947824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 426/858] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:30.948743 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:30.974433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.017466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a15e9e-0ed0-4c10-92bf-55e98761c13b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.053006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.053682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.053989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.054266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.055016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:31.055548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.056713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.061292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0a9bf-cd32-4bb0-8bf4-c689b5feab35 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.066268 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 433/859] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:31.066268 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.105034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.105867 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.106165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.106511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.116565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.118057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:31.134068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:31.135496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 427/860] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:31.136982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.174082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.188742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16abca1-eadb-48b8-b2aa-aadd8b314d9a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.216710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.227078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.227764 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.228049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.228336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.229115 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:31.229527 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.231050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.236048 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 434/861] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:31.236667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.252252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67289cb4-ed15-4505-8b8b-672a11761ede None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.288480 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.289220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.289440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.289708 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.290522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:31.290858 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.292536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.302562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 428/862] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:31.302562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.350677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35accd09-a117-487a-a96c-d3975f187815 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.404060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.404745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.405096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.405440 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.407067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:31.407387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.409406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.428213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.437575 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 435/863] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:31.438417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148bcd-b68d-4b46-a4ad-1d2afaaa77ff None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.442768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.489408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.490996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.491297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.491577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.492333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:31.492646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.494041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.506406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.506797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 429/864] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:31.569124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354b23a-c5f6-4954-80e5-b7917afde262 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.607768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.608451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.608735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.609015 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.695258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.696731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.752106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:31.804848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 436/865] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:58:31.810458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:31.917541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9dc732-b799-4909-89cc-dd4cd8ae5c02 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:31.956006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:31.957030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:31.957470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:31.957882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:31.970281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:31.971947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:31.990174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:31.991163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:31.992072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:31.992072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:31.992072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:31.992072 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:31.993892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 430/866] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:31.999619 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:32.100420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39edbc8-1fd2-4fb6-bfca-4ab4e0aaa830 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:32.135592 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:32.136433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:32.136808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:32.137174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:32.137999 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:32.138421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:32.139914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:32.152341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 437/867] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:32.157784 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:32.171736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:32.263346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4cf7-5099-4393-a85f-237152a0a0ae None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:32.299371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:32.300825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:32.301247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:32.301682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:32.308961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:32.310569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:32.325346 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:32.326291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:32.327264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:32.329305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 431/868] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:32.335219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:32.355069 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:32.440325 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb1f01-e51c-4813-b1a0-146c5e8d264e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:32.473975 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:32.474636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:32.474943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:32.475215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:32.476001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:32.476607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:32.478050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bb6a7-6cab-4567-a533-fd37811b97b2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:32.491017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 438/869] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:32.496749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:32.577841 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:32.604235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f66f4-8def-49c3-9a39-4d3841b25c06 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:32.639721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:32.640478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:32.640771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:32.641052 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:32.641919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=72e29083d38a4cb7a35ba84a21b33cee) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:32.642238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:32.643773 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad62a9-87f6-4bb5-a4ad-6e119fba8508 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:32.651510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 432/870] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:32 2022] GET /identity/v3/role_assignments?user.id=72e29083d38a4cb7a35ba84a21b33cee&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:33.102219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf634-db10-493f-be79-a7f32285fc36 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.102581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf634-db10-493f-be79-a7f32285fc36 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.102804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf634-db10-493f-be79-a7f32285fc36 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.104622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 439/871] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:33.110083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.110382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.110657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.127978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:33.129184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:33.199616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 433/872] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:33.222055 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf634-db10-493f-be79-a7f32285fc36 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:33.295201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:33.331355 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf634-db10-493f-be79-a7f32285fc36 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:33.367420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:33.368162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.368448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.368729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.369434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:33.370880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:33.383175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:33.383962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:33.384622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:33.385266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 440/873] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:33.391044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:33.460367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:33.502537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca5e0-edbc-4e45-9a6e-60b1356657fb None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:33.538026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:33.538729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.539024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.539306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.540109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:33.540420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:33.541959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec5d7c-5fd2-4d83-8c5c-88afa23915cf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:33.547463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 434/874] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:33.553033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:33.658286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587da3b-985f-460a-9614-278ebd85acda None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.658928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587da3b-985f-460a-9614-278ebd85acda None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.659302 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587da3b-985f-460a-9614-278ebd85acda None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.661059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 435/875] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:33.662052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e439e6-3f21-4a2f-a470-3398c5a20387 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:33.668082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61e27-21fb-45f0-b22c-4c9be4f9f01a None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.668614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61e27-21fb-45f0-b22c-4c9be4f9f01a None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.669098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c61e27-21fb-45f0-b22c-4c9be4f9f01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.686725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-98c61e27-21fb-45f0-b22c-4c9be4f9f01a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:33.688315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-98c61e27-21fb-45f0-b22c-4c9be4f9f01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:33.692019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:33.699774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:33.700745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.701205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.701620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.702463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:33.702932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:33.704537 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:33.714823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 441/876] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:33.763618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 436/877] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:33.786723 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:33.796159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0f0-d1a8-459e-b7dd-e90e35688ff5 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.796542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0f0-d1a8-459e-b7dd-e90e35688ff5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.796829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dc0f0-d1a8-459e-b7dd-e90e35688ff5 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.798574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 437/878] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:33.804816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.805189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.805536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.824803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:33.826237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:33.898965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:33.918386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eeecc-c95c-4032-891a-93e51f8f717d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:33.919675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 438/879] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:33.945198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:33.959391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:33.960072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:33.960358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:33.960638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:33.961393 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:33.962843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2c6b9-47ff-4da4-9a06-05afde4a93be None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:33.982984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 442/880] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:33 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:34.064620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906faa2-17d8-47db-a573-3cac123bcc01 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:34.112835 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:34.113609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:34.113897 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:34.114171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:34.114938 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:34.116400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9a57-f936-49d8-9bea-8a5a3d69b560 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:34.133620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 439/881] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:33 2022] POST /identity/v3/services => generated 269 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:58:35.050350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6531c2-3cbe-4175-bb1d-ba00eeb386b6 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.050845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6531c2-3cbe-4175-bb1d-ba00eeb386b6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.050845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6531c2-3cbe-4175-bb1d-ba00eeb386b6 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.052532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 443/882] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:35.057800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.058186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.058373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.075571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:35.076771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:35.119852 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:35.158519 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 440/883] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:35.182165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6531c2-3cbe-4175-bb1d-ba00eeb386b6 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:35.241875 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:35.289329 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6531c2-3cbe-4175-bb1d-ba00eeb386b6 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:35.326520 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:35.327310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.327601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.327885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.339295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:35.347588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:35.348310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:35.349093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:35.349631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 444/884] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:58:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:35.355402 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:35.457763 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890658f-382f-48bc-82f4-4b8857d07668 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:35.495284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:35.495976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.496265 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.496546 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.497300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:35.497609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:35.499027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:35.508227 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 441/885] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:58:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:35.513566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:35.616331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dae2-7823-4f04-bf31-deaa156adf71 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:35.637225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:35.652177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:35.652992 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.653280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.653564 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.664935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:35.667770 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:35.688270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:35.689123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:35.689849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:35.689849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:35.689849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:35.689849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:35.690090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 445/886] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:35.695693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:35.727995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:35.797807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b203d-9b13-45e8-9d1c-ddf5bb017db9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:35.831625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:35.832304 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:35.832588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:35.832866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:35.833595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:35.833904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:35.835383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:35.847913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 442/887] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:35.853850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:35.963883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c4b18-6acc-4716-8d9f-e9e51f1da130 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:35.999166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:35.999999 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.000287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.000568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.008704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.010215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d4087cf0-7117-4e58-b37b-e72444b147f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:36.025131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:36.026052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:36.026924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:36.030756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 446/888] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:36.032463 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.113402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe26b-bd5f-41bf-ab67-536699922da9 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.113402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe26b-bd5f-41bf-ab67-536699922da9 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.113402 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe26b-bd5f-41bf-ab67-536699922da9 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.114350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 447/889] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:36.119977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45de2f-0500-42d6-b99c-ea46f7bf019b None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.120526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45de2f-0500-42d6-b99c-ea46f7bf019b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.121002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45de2f-0500-42d6-b99c-ea46f7bf019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.138467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3c45de2f-0500-42d6-b99c-ea46f7bf019b None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:36.140033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3c45de2f-0500-42d6-b99c-ea46f7bf019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:36.141241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c415-5cdd-4e71-8ccd-bf1ccdbc195f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.144495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.167342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.181834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.182801 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.183287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.183736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.184761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:36.185243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.186986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.206443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 443/890] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:36.213084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.222616 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 448/891] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:36.238579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39cdc-7019-4eae-af5e-cc2a49fcb045 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.239082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39cdc-7019-4eae-af5e-cc2a49fcb045 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.239498 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade39cdc-7019-4eae-af5e-cc2a49fcb045 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.241233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 449/892] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:36.247114 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.247404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.248034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.268119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:36.269317 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:36.332231 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaba1d0-da73-4fd7-8f0d-0271ee709f77 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.351938 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 450/893] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:36.353053 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.378382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.379085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.379366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.379630 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.400010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.446710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.454021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.455536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f8441-afc9-4460-912e-51b65595a8d1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.460934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481734-4da0-4ada-a48d-72532374d7f5 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.497373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.497963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.498246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.498526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.499281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.500655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.514729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 451/894] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:36 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:36.515206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.563009 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 444/895] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:58:36.564374 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688415d-28f2-47ae-bb29-8da67c1acbdd None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.564659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688415d-28f2-47ae-bb29-8da67c1acbdd None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.564933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688415d-28f2-47ae-bb29-8da67c1acbdd None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.566406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 445/896] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:36.569028 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688415d-28f2-47ae-bb29-8da67c1acbdd None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.637725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.650038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570c9c4-1ee6-416b-87ca-f8ff8e3ac71d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.687358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.688176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.688456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.688779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.689392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.689983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688415d-28f2-47ae-bb29-8da67c1acbdd None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.690809 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-2ddc430a-9192-4bc6-9c22-93ae06a2df2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:36.706638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:36.708480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:36.709211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 452/897] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:36.711978 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.712281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.712563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.733199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:36.734415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:36.736585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.736790 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.738266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.739394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.739394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.751709 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.753113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:36.771499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:36.772279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:36.773017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:36.773017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:36.773017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:36.773017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:36.773017 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 446/898] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:36.773799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.818271 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 453/899] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:36.819162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.890978 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d802-98ce-4798-bc49-f3bb8bbd33c0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.892928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.926307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac0e8-b31a-4e85-bd28-f1a27c3982df None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:36.931274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.932174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.932460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.932733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.933442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:36.933738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.935602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.945829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 447/900] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:36.945829 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:36.966583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:36.967309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:36.967595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:36.967878 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:36.968606 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:36.968919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:36.970307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:36.977772 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:36.987568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 454/901] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:36.988510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.054546 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6f09c-afcd-4660-a363-76f3e3bae11a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.088680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.089559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.089842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.090119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.090851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.092229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.098027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956c84-e0e0-430d-aeca-46ca896e763e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:37.105092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:37.105895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:37.106578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 448/902] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:37.107334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.142632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.143847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.144321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.144748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.145998 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.146512 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.148638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.149021 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.157028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 455/903] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.157897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.249846 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.268105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d050-b291-46d5-8486-ce4db69d9dbf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.299343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89e8f-b1f3-432b-9c58-644c797e97a0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.305947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.306860 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.307141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.307418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.314469 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.315955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:37.330845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:37.331687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:37.332439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 449/904] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:37.332850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.340989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.341881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.342009 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.342222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.342974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.343284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.344672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.355932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 456/905] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.355932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.436833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.447738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d7fea-9fdf-40db-8627-bf4c637b044b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.466699 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35d50-8e51-473c-86c9-960a49b1e06d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.483121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.483792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.484076 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.484349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.485140 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] RBAC: Adding query filter params (interface=public, service_id=d30273a152ac476dba1cf1a1b9208701, region_id=RegionOne) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.485450 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.486843 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.493420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.499336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 450/906] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/endpoints?service_id=d30273a152ac476dba1cf1a1b9208701&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.500202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.502999 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.504259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.504259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.504259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.505013 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.505322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.506797 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.523837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 457/907] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.523837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.615569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c937944-6e82-4518-ac0b-6b31df64f376 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.635982 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12a516-a810-4657-b9fe-898b1a013237 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.652462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.653456 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.653927 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.654205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.654974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.655286 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.656686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.666780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 451/908] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.666780 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.681346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.682363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.683001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.683197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.683505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.684313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.685760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.702893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 458/909] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:58:37.702893 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:37.773353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:37.822626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dbfd-44b4-4f75-bae1-16ebe5ce58e5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.841166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e237de-d036-4142-a42a-81967b9f7afa None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:37.861385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.862192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.862764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.863123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.864048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] RBAC: Adding query filter params (role.id=f0bafde455fe40bdb5710fedfa27fcda, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=72e29083d38a4cb7a35ba84a21b33cee) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.864432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.866047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.873360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 452/910] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/role_assignments?user.id=72e29083d38a4cb7a35ba84a21b33cee&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f0bafde455fe40bdb5710fedfa27fcda => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.897098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:37.898099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:37.898550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:37.899030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:37.900024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] RBAC: Adding query filter params (interface=public, service_id=a8253882a97242f9ad2b816757cf95c9, region_id=RegionOne) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:37.900586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:37.902187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe2e58-5730-462c-b1a1-3034693ec078 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:37.912737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 459/911] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/endpoints?service_id=a8253882a97242f9ad2b816757cf95c9&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:37.917991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:38.009111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:38.029108 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878dc17-97cb-446e-adcc-52dbc735720d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:38.065611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:38.066648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:38.067154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:38.067615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:38.068532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:38.070116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca18d62-7d8f-49cb-87df-aee97ebd04d2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:38.082871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 453/912] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:37 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:58:38.777230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8226a-7f74-48ae-92e8-7f042936d682 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:38.777733 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8226a-7f74-48ae-92e8-7f042936d682 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:38.777837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8226a-7f74-48ae-92e8-7f042936d682 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:38.779457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 460/913] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:38.785105 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:38.785489 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:38.785665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:38.804745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:38.805920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:38.878878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 454/914] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:38.897491 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8226a-7f74-48ae-92e8-7f042936d682 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:39.004295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8226a-7f74-48ae-92e8-7f042936d682 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:39.019370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:39.041933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:39.042889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:39.043174 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:39.043450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:39.044129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:39.045565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:39.059142 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:39.060028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:39.060718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:39.064398 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 461/915] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:39.067046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:39.144825 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:39.168693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbd63-8c4e-4d9a-901d-6d2c3bd49f0b None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:39.205473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:39.206542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:39.207046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:39.207514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:39.208435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:39.208934 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:39.210529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:39.216123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 455/916] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:39.226730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:39.325205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458dbec-7f17-469b-9626-14a5225cb11e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:39.359912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:39.360582 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:39.360863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:39.361137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:39.361849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:39.362154 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:39.363562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:39.373526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 462/917] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:39.374921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:39.480597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d9a8f-5c76-4df2-a5f2-9ac649a85d03 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:39.515612 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:39.516687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:39.517167 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:39.517635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:39.518618 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] RBAC: Adding query filter params (interface=public, service_id=1aa1ada3bcf74df084fb9ff41cb493f0, region_id=RegionOne) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:39.519170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:39.520736 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03b17-c769-48a4-b05a-b003854ccd40 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:39.526790 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 456/918] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:39 2022] GET /identity/v3/endpoints?service_id=1aa1ada3bcf74df084fb9ff41cb493f0&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:39.534888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:39.591161 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:39.635936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d1100-8fc1-49fa-bc9f-609559b3337e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:39.670327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:39.671025 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:39.671304 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:39.671580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:39.672266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:39.673644 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2ea8-ede8-42f1-b871-45df4cf839c6 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:39.686913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 463/919] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:39 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:58:40.025755 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c59a1-fe20-421f-999f-b89fd0141e4c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.026274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c59a1-fe20-421f-999f-b89fd0141e4c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.026377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c59a1-fe20-421f-999f-b89fd0141e4c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.028096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 457/920] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:40.034213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96ba2-e51e-4270-9c52-cc51b30c6379 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.034720 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96ba2-e51e-4270-9c52-cc51b30c6379 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.034914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96ba2-e51e-4270-9c52-cc51b30c6379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.052068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-58b96ba2-e51e-4270-9c52-cc51b30c6379 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:40.053283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-58b96ba2-e51e-4270-9c52-cc51b30c6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:40.127943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 464/921] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:40.151198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c59a1-fe20-421f-999f-b89fd0141e4c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.155859 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.212818 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b94ab-5e3f-495b-bf47-e5e15fa7ef89 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.213254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b94ab-5e3f-495b-bf47-e5e15fa7ef89 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.213712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b94ab-5e3f-495b-bf47-e5e15fa7ef89 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.215621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 465/922] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:40.220515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a6ee-cd21-42c3-9a33-8a031f6d3100 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.220811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a6ee-cd21-42c3-9a33-8a031f6d3100 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.221095 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a6ee-cd21-42c3-9a33-8a031f6d3100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.241096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-6c31a6ee-cd21-42c3-9a33-8a031f6d3100 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:40.242303 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-6c31a6ee-cd21-42c3-9a33-8a031f6d3100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:40.271640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c59a1-fe20-421f-999f-b89fd0141e4c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.281280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.320538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.321787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.322307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.322595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.323294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.324757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.325683 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 466/923] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:40.326909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca37e5-63d0-425c-a0fc-7944595716a6 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.327295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca37e5-63d0-425c-a0fc-7944595716a6 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.327579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca37e5-63d0-425c-a0fc-7944595716a6 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.329103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 467/924] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:40.336465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.336978 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.337451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:40.343151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:40.344059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.345131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 458/925] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:40.350078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.359433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:40.360663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:40.417745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.443913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 468/926] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:40.443913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.463927 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed840-686f-41d7-933a-c898c75a26e2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.506343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.507255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.507541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.507865 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.518958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:40.527445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:40.528262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.528977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 459/927] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:40.529571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.537852 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.545628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dfb28-c33a-4da5-9508-a2cbaf7bc76b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.586269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.587260 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.587550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.588050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.589067 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:40.589389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.590855 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.601721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 469/928] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:40.601721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.651358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265187-7ef4-4958-b37c-962fa5a69135 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.677830 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.686907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.687738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.688021 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.688297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.688953 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.690336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:40.702785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:40.703592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:40.707336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 460/929] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:40.708125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.720437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573881-4233-45f6-a9f4-f601eef27b2c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.757674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.758736 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.759196 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.759757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.760684 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:40.761187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.762782 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.771578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 470/930] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:40.772391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.800283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.819095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02132ddf-118e-4146-8ef2-a6f71847611a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.856554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.857535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.858460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.858945 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.860281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:40.860875 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.862265 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.871872 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 461/931] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:40.871872 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.886985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edbffc-ad37-41e0-b74d-6755176a16d2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:40.924839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:40.925523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:40.925811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:40.926091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:40.926853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:40.927167 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:40.928569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:40.933521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:40.933934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 471/932] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:40.934672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:40.987499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32dda6-c65d-4d38-8c70-418ee8ff53ff None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.023401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.024223 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.024510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.024791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.029891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:41.037701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.039371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.046552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8528-6913-4dc1-b74c-4a380c108730 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:41.056686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:41.057457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:41.058213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:41.058213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:41.058213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:41.058213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:41.058213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 462/933] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:41.058920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.088139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.088811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.089097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.089374 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.090237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.091789 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.122721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 472/934] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:41.122721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.183840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71142b0e-1db5-48f6-848b-2abcd5124189 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.195498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:41.238721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.238721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.238721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.238721 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.239171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:41.239171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.239171 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.244564 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 463/935] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:41.249961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.273972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa58131-057b-416f-89ef-9585e9ddb8b0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.313481 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.314092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.314379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.314659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.315458 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:41.315774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.317745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.336001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 473/936] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:41.336952 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.340663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:41.386393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0c258-f053-4856-a682-3ce24d1e6250 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.431472 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.431694 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.432265 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.432617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.433377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.444685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.459155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6f05-7ee2-4dff-9f6b-7f21a6c26777 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.473095 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 464/937] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:41.508954 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.510191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.510655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.511165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.520297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.522084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:41.538948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:41.539864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:41.540673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:41.543291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 474/938] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:41.549426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.581401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:41.675776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06075b32-be51-419b-9df4-c2e8fcea932b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.712805 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.713749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.714176 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.714587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.715593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:41.716111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.717697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.738264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 465/939] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:41.745311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.813947 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:41.861650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600c90a-459b-4127-a84c-367323a7cd14 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:41.898113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:41.899190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.899617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.900033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.911072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:41.912751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-31232bb3-8df9-4153-bf47-7756a05db7cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:41.931309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:41.932360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:41.933353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:41.933353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:41.933353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:41.933353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:41.935625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 475/940] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:41.943749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:41.982407 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02e7b-6fe1-4b04-b2aa-fd33ea01aba3 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.982949 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02e7b-6fe1-4b04-b2aa-fd33ea01aba3 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.983382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d02e7b-6fe1-4b04-b2aa-fd33ea01aba3 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:41.986056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 476/941] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:41.992691 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:41.993603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:41.994094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.013386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:42.014769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:42.048179 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.073392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45a432-feb6-46cb-a802-a6883117a1cb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.090729 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 477/942] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:42.109597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.120917 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.122280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.122871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.123634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.124973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:42.125516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.127752 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.147319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 466/943] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:42.148608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.163090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.241480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62c9cf-5f4b-4380-8d7b-b21030d38537 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.270559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c83bc-0aeb-4d2c-9b4a-ec7ab4b1103d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.277482 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.278521 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.279004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.279998 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.280842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.283409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:42.301089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:42.302594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:42.303707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:42.311465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 478/944] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:42.313369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.317391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.318202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.318484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.318796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.327255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.328810 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:42.344734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:42.345575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 467/945] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:42.351853 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.359086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.448452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e24977-6353-4f78-9755-57bfc2279063 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.451849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.483249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d7df-4c99-4723-996c-9284b80632ee None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.485725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.486674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.486942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.487317 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.488140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:42.488550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.490034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.500084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 479/946] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:42.501082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.527146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.528669 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.529132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.529819 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.531004 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:42.531464 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.533776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.550150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 468/947] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:42.555817 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.626849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e361a9a-c3ff-4a87-a15f-f73bd70b381b None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.631333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.672944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.674018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.674134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.674531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.675413 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:42.675884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.677411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.688160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 480/948] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:42.688672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3e5d-e443-4574-959e-cc1ee633b458 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.689190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:42.722059 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:42.736983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.738866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.739296 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.739765 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/72e29083d38a4cb7a35ba84a21b33cee/roles/f0bafde455fe40bdb5710fedfa27fcda` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.743159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=72e29083d38a4cb7a35ba84a21b33cee, role_id=f0bafde455fe40bdb5710fedfa27fcda)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.745478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b19f5-5203-441a-8da9-77b6aaf40b46 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.764595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 469/949] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:58:42 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/72e29083d38a4cb7a35ba84a21b33cee/roles/f0bafde455fe40bdb5710fedfa27fcda => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:58:42.812056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3252ec5-fcbf-4b1e-b124-74add0a273f1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:42.852883 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:42.853696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:42.853979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:42.854256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:42.855190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:42.856662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627fba6-a0c1-4b40-839c-ce6e8b0aa81a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:42.880170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 481/950] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:43.504049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4347-9b7e-48e1-b407-6335627713bf None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:43.504563 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4347-9b7e-48e1-b407-6335627713bf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:43.504634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a4347-9b7e-48e1-b407-6335627713bf None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:43.506161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 470/951] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:43.512208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9b6a-8ab2-478f-ba1b-502268104497 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:43.513086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9b6a-8ab2-478f-ba1b-502268104497 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:43.513556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a9b6a-8ab2-478f-ba1b-502268104497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:43.532188 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3b9a9b6a-8ab2-478f-ba1b-502268104497 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:43.533660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3b9a9b6a-8ab2-478f-ba1b-502268104497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:43.614967 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 482/952] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:43.636111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4347-9b7e-48e1-b407-6335627713bf None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:43.751717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a4347-9b7e-48e1-b407-6335627713bf None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:43.775239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:43.787214 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:43.787889 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:43.788175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:43.788451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:43.789169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:43.790632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:43.792071 dv-cinder-835881-13-smb devstack@keystone.service[144062]: WARNING keystone.server.flask.common [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 19:58:43.815657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.sql.core [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:58:43.815657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:58:43.815657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [parameters: {'id': '8a6319d3ac504d759d1760d456486b35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:58:43.815657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144062) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:58:43.820186 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56f32-7ce5-491f-9242-23e716ffd990 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:43.820705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56f32-7ce5-491f-9242-23e716ffd990 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:43.821171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56f32-7ce5-491f-9242-23e716ffd990 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:43.826671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 483/953] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:43.828444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f144c-5738-435c-917c-c4df839a85df None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:43.828926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f144c-5738-435c-917c-c4df839a85df None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:43.829411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f144c-5738-435c-917c-c4df839a85df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a6319d3ac504d759d1760d456486b35.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a6319d3ac504d759d1760d456486b35. May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application conn.query(q) May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:58:43.833521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result.read() May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 19:58:43.834224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application next(self.gen) May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application yield resource May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application next(self.gen) May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise self.value May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application session.commit() May 19 19:58:43.837217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.session.flush() May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application compat.raise_( May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:58:43.838154 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:58:43.839005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application conn.query(q) May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result.read() May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:58:43.839692 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [parameters: {'id': '8a6319d3ac504d759d1760d456486b35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:43.840457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:43.841134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a6319d3ac504d759d1760d456486b35. May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 471/954] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 19:58:43 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:43.842157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:43.859504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-d25f144c-5738-435c-917c-c4df839a85df None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:43.861230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-d25f144c-5738-435c-917c-c4df839a85df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:43.907061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:43.947914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 484/955] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:43.970461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f144c-5738-435c-917c-c4df839a85df None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:43.977815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad0b99-90b1-4ef3-829a-22a1f8c67ea9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:44.015512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:44.016711 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:44.017129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:44.017584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:44.025083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:44.027063 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:44.042438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:44.043306 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:44.044067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:44.046762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 472/956] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:44.052947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:44.082263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f144c-5738-435c-917c-c4df839a85df None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:44.098566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:44.118442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:44.119358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:44.119693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:44.120049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:44.120721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:44.122227 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:44.134667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:44.135566 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:44.136281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:44.140979 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 485/957] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:44.142267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:44.153894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:44.174675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2978a-d6f5-411a-bdcb-2b49c84b7051 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:44.212846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:44.213919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:44.214478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:44.214987 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:44.215926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:44.216409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:44.218015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:44.240787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 473/958] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:44.251088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a787f-b87b-415d-90a2-c5f96d6e9e53 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:44.289016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:44.289997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:44.290459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:44.290963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:44.291901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:44.292391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:44.293991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc0ff8-8548-4fa2-87e6-97c1c5f968ea None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:44.300302 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 486/959] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:44.308047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:44.420276 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:44.425272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825369ec-ca28-4b3b-9d8b-5f7aaebb0f07 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:44.464713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:44.465694 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:44.466166 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:44.466444 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:44.467196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] RBAC: Adding query filter params (type=compute) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:44.467541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:44.468915 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9fece-65d3-47ca-8668-0e3fa5b81cce None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:44.474167 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 474/960] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:45.157479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa31e-a43d-4eac-ad30-5f97f3dab0f3 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.157995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa31e-a43d-4eac-ad30-5f97f3dab0f3 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.158095 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fa31e-a43d-4eac-ad30-5f97f3dab0f3 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.159832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 487/961] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:45.164360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d976e-cd6f-4cd1-9ef8-6f77fcccbbc3 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.164782 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d976e-cd6f-4cd1-9ef8-6f77fcccbbc3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.164853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.164919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d976e-cd6f-4cd1-9ef8-6f77fcccbbc3 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.165141 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.165428 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.166581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 475/962] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:45.171585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.171882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.172166 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.183459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:45.184956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:45.190762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:45.192277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:45.260353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 488/963] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:45.275681 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 476/964] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:45.283643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.285861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.301920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.407113 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14855839-417e-42ee-98b7-5d5856f298e5 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.415922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.428674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92e9ba-f9db-4d31-994a-0de067c5b959 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.444781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.445707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.445995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.446272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.460341 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:45.472532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:45.473357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:45.474083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:45.474628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.475309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.475591 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.475866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.476840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:45.477903 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 489/965] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:45.483024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:45.484222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:45.494123 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:45.495185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:45.496131 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:45.498511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 477/966] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:45.504435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.554121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.595754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10b674-f12c-4f94-8256-c1c0d8af926c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.624920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc4a6-ccc0-46e9-9cbe-319430a004a5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.641083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.641768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.642056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.642343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.643119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:45.643434 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:45.644813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:45.657971 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 490/967] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:45.658881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.665869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.666952 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.667459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.667931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.668926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:45.669432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:45.671158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:45.677249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 478/968] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:45.682673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.713795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.770627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797955-ae0f-4ae7-aae1-2b574f400db1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.795356 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.810749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.812008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.812580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.813047 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.815595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cc7b1-9eab-4b3d-93e1-b597b0acb7b1 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:45.824523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:45.826298 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:45.843908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:45.844710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:45.845479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:45.845479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:45.845479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:45.845479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:45.847412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 491/969] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:45.853780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.857083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:45.858383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:45.858383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:45.858569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:45.859376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:45.859754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:45.861211 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:45.871925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 479/970] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:45.872984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:45.977770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:45.988412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffee36-6a32-4c2e-9e97-8e9e4b500419 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.000910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a42a1-4588-40c1-95e5-f65446c50bfd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.024796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.025847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.026425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.026997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.027972 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:46.028472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.030224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.038466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.039182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.039472 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.039753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.040552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] RBAC: Adding query filter params (interface=admin, service_id=1aa1ada3bcf74df084fb9ff41cb493f0, region_id=RegionOne) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:46.040901 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.042401 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.045426 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 492/971] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:46.053068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 480/972] 10.222.0.77 () {56 vars in 1249 bytes} [Thu May 19 19:58:45 2022] GET /identity/v3/endpoints?service_id=1aa1ada3bcf74df084fb9ff41cb493f0&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:46.054223 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.054327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.104149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:46.169250 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9f69-4fb7-4f85-99a9-3cda82e4224f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.186353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9042608-e08d-4d89-a398-9789144cb7f0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.215999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.217373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.218104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.218559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.219695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.221312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.222269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.223904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.224363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.224814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.233799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.234301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 481/973] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:46 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 19:58:46.235710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:46.252934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:46.254017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 19:58:46.255098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:46.257438 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 493/974] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:58:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:46.263549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.281010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:46.388659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f586c1a-4191-4c3d-b554-2efb1d49b9f9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.427339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.428280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.428741 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.429158 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.430151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:46.430707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.432384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472b0ce-78a8-40e3-81e5-52ba4356014d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.452199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 482/975] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 19:58:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:46.458308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.560614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:46.566913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebe13-0326-4cc8-9b14-fc7b21953fc5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.607206 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.607876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.608160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.608436 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.681083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.682636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c58fc-c268-4e1e-8318-9133b1342b75 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:46.706821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985022b2-fb09-4aa5-ad2c-ef479e338b42 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.707125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985022b2-fb09-4aa5-ad2c-ef479e338b42 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.707385 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985022b2-fb09-4aa5-ad2c-ef479e338b42 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.709610 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 483/976] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:46.718593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc86e-975c-4555-9a67-2d3330142eee None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.718908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc86e-975c-4555-9a67-2d3330142eee None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.719197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bc86e-975c-4555-9a67-2d3330142eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.738764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-197bc86e-975c-4555-9a67-2d3330142eee None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:46.740187 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-197bc86e-975c-4555-9a67-2d3330142eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:46.792348 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:46.800220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 494/977] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:58:46.801731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704e61-e756-4b18-9273-13ba670a8997 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.802065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704e61-e756-4b18-9273-13ba670a8997 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.802346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704e61-e756-4b18-9273-13ba670a8997 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.803973 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 495/978] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:46.807274 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704e61-e756-4b18-9273-13ba670a8997 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.813575 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:46.826910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 484/979] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:46.828470 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.828768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.829350 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.847556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:46.848750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:46.921264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 485/980] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:46.922114 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:46.932879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704e61-e756-4b18-9273-13ba670a8997 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:46.977662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:46.978642 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:46.979065 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:46.979342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:46.991950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:46.993642 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:47.013184 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:47.014022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:47.014825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:47.014825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:47.014825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:47.014825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:47.014825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 496/981] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:47.015517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.029529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ade55-925a-42a0-8eb8-96b58e4f3c3a None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.067980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.069899 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.075770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.076460 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.076746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.077023 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.077851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.079400 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.092534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.sql.core [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:58:47.092534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:58:47.092534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [parameters: {'user_id': '1c9fffdea6bc40cfa5d90b0eb7061ac8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:58:47.092534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144062) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application conn.query(q) May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result.read() May 19 19:58:47.099908 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:58:47.100702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application next(self.gen) May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application yield resource May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application next(self.gen) May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.session.rollback() May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.force_reraise() May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise self.value May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application session.commit() May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 19:58:47.101885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._prepare_impl() May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.session.flush() May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._flush(objects) May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application compat.raise_( May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application flush_context.execute() May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rec.execute(self) May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 19:58:47.102647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 19:58:47.104670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result = self._query(query) May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application conn.query(q) May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application result.read() May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 19:58:47.105387 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [parameters: {'user_id': '1c9fffdea6bc40cfa5d90b0eb7061ac8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:47.106146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 19:58:47.108157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 486/982] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 19:58:46 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:47.110653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.130311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a7469-4f1c-45e0-9a97-e0d2e8de94ec None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.165150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.166201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.166643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.167087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.168131 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.169700 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.183820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 497/983] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:47 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:47.195803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.218437 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd75c5-11d6-4dbf-83b0-3060ab0168bb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.273335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.274372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.275022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.275527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.276473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:47.277003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.279076 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.299229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 487/984] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:47.301029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.320258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e6eef-944f-4ea7-86f0-4db9059e2423 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.331464 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.362995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.363867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.364328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.364674 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.366249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.376713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.378392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:47.394844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:47.395921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 19:58:47.396961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:47.399258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 498/985] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:47.404593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.429846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881abd-0d43-4770-a247-c86df0dd1329 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.475998 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.477376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.477660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.477933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.486948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.489086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:47.507088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:47.508117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:47.509098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 488/986] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:47.515620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.529238 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f5d2-3b30-4729-88bf-a9d42f19a118 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.565019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.565490 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.565863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.566262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.567205 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:47.567604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.569128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.606432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 499/987] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:47.643066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09cdb4-bc54-417e-af8d-507415eec291 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.654485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.682537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.683620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.684043 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.684458 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.685423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:47.685877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.687559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685b21b-67f3-46a6-a97e-89fd60c9a678 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.701779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 489/988] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:47.711881 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:47.743850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:47.827297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4f46-134a-425b-a2e2-74512e635511 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:47.863480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:47.864089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:47.864387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:47.864662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:47.865515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] RBAC: Adding query filter params (role.id=f0bafde455fe40bdb5710fedfa27fcda, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=72e29083d38a4cb7a35ba84a21b33cee) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:47.865840 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:47.867332 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d49123-4692-42ed-91ca-4fb0724690ce None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:47.874181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 500/989] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:47 2022] GET /identity/v3/role_assignments?user.id=72e29083d38a4cb7a35ba84a21b33cee&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f0bafde455fe40bdb5710fedfa27fcda => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:48.594147 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981445e-389d-487b-82af-62a42f275c26 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:48.594660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981445e-389d-487b-82af-62a42f275c26 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:48.594763 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981445e-389d-487b-82af-62a42f275c26 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:48.596175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 490/990] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:48.601943 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:48.602383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:48.602550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:48.619539 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:48.620739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:48.694845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 501/991] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:48.714271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981445e-389d-487b-82af-62a42f275c26 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:48.821646 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981445e-389d-487b-82af-62a42f275c26 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:48.855235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:48.855973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:48.856241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:48.856531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:48.857177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:48.858561 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:48.870737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:48.871578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:48.877503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 491/992] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 19:58:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:48.879784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:48.903290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:48.989056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a138b7-147e-4e13-ad62-92a2b9076ea0 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:49.026986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:49.027659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.027951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.028219 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.028931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:49.029242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:49.030775 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:49.041832 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 502/993] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:49.042729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:49.075754 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:49.150303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11bd-0f10-47fb-97ca-959eda57febe None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:49.185888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:49.186569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.186888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.187168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.187882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:49.188199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:49.189579 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc00d9-d2e7-4a34-b42b-ce80b88c1bf8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:49.195188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 492/994] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 19:58:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:49.200976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:49.293169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:49.312936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da33d3-d9a3-49b2-b670-9870ecc668cf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:49.351486 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:49.352216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.352505 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.352760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.353588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:49.355012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daa348-6503-4c24-87d4-af0f78d3d8dc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:49.371878 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 503/995] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:49.485836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a719-8aa0-48e4-a58c-e4ac969c7ad0 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.486101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a719-8aa0-48e4-a58c-e4ac969c7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.486311 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a719-8aa0-48e4-a58c-e4ac969c7ad0 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.487899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 493/996] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:49.493687 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.494061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.494338 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.513600 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:49.514887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:49.595244 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 504/997] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:49.618647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a719-8aa0-48e4-a58c-e4ac969c7ad0 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:49.718795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:49.727074 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a719-8aa0-48e4-a58c-e4ac969c7ad0 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:49.761182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:49.761912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.762190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.762462 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] PATH_INFO: `/v3/services/compute` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.763142 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:49.764520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:49.776768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:49.777655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:49.778396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:49.782771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 494/998] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:49.784471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:49.857980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:49.890897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9a6f-cb0c-493f-8686-5b0f7978d34c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:49.927760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:49.928433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:49.928717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:49.928993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:49.929728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] RBAC: Adding query filter params (name=compute) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:49.930040 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:49.931659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:49.942157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 505/999] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:49.943896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.050821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6c72-0d67-4219-b82b-9b9e069d1057 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.085080 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.085760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.086042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.086315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.087061 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] RBAC: Adding query filter params (type=compute) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:50.087396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.088774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc90df-7af5-44dc-8557-7a0a838ce67c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.098628 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 495/1000] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:50.100221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.128203 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5552-6b8f-424a-909a-5764d8f4dfdd None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.128536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5552-6b8f-424a-909a-5764d8f4dfdd None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.128789 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5552-6b8f-424a-909a-5764d8f4dfdd None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.130194 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 496/1001] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:50.135287 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.135578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.135857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.155518 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:50.157019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:50.177279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:50.211424 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf08-e250-47d3-9404-8aceb7f7c75c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.238739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 497/1002] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:50.252851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.253593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.253965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.254306 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.255346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] RBAC: Adding query filter params (interface=public, service_id=14e734ffe4464955b1560f91b59ea4ad, region_id=RegionOne) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:50.255666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.256604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.257061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.258563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:50.263189 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 506/1003] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:50 2022] GET /identity/v3/endpoints?service_id=14e734ffe4464955b1560f91b59ea4ad&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:50.269628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.366247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551d48c-3f8e-4bdc-8b2b-ef54db63eebc None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.378585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b3eca-052d-4c86-9609-4019705c2411 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.402745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.403547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.403831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.404102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] PATH_INFO: `/v3/services/image` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.404753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.406117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.413032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.413707 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.413994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.414327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.415015 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.416562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:50.418075 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:50.418984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:50.419702 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:50.420365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 498/1004] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:58:50 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:50.426076 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.428294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 507/1005] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:50 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:58:50.455316 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:50.550997 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c586c-0da5-4870-9fb6-0e9f8211ba15 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.588020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.588715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.589034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.589314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.590044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] RBAC: Adding query filter params (name=image) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:50.590356 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.591798 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e60164-95ef-4c27-bff2-e356d3a37a6d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.602364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 499/1006] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:50.603590 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:50.678545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:50.718638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28560-9363-463f-8695-3921a59c5973 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:50.757620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:50.758556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:50.758873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:50.759144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:50.759906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:50.760211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:50.761617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1bb9e-e6ff-41b2-abef-5bdf13fbb3f9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:50.766749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 508/1007] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:51.611399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d096-db30-45d7-890b-f97563a539f8 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:51.611923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d096-db30-45d7-890b-f97563a539f8 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:51.612032 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6d096-db30-45d7-890b-f97563a539f8 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:51.613363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 500/1008] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:51.619097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:51.619717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:51.619862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:51.638451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:51.639705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:51.707957 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 509/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:51.731730 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6d096-db30-45d7-890b-f97563a539f8 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:51.819627 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:51.841368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6d096-db30-45d7-890b-f97563a539f8 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:51.877602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:51.878333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:51.878615 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:51.878920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:51.880125 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:51.881581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fed06a-d4ae-460b-bbd5-a4ead0f47df8 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:51.883464 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 501/1010] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:51.889366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:51.946091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:51.991545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b307b52-c4ba-4ac7-bca3-0f572f964b09 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:52.026640 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:52.027346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.027635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.027913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.028664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:52.030092 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714a687-509b-4ca8-a138-704e686fe8c8 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:52.066721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 510/1011] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:51 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:52.657182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8599-b215-4e5f-b353-1b8b300299ab None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.657666 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8599-b215-4e5f-b353-1b8b300299ab None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.657769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8599-b215-4e5f-b353-1b8b300299ab None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.659186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 502/1012] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:52.664573 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539025-75a3-4978-b8fd-68094425baca None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.664995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539025-75a3-4978-b8fd-68094425baca None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.665085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2539025-75a3-4978-b8fd-68094425baca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.684358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-c2539025-75a3-4978-b8fd-68094425baca None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:52.685548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-c2539025-75a3-4978-b8fd-68094425baca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:52.756686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 511/1013] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:52.780100 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8599-b215-4e5f-b353-1b8b300299ab None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:52.894266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8599-b215-4e5f-b353-1b8b300299ab None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:52.929174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:52.929983 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.930264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.930542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.931457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:52.932838 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d1e6f189-d22a-466b-ab2c-16fc55e42fb9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:52.945252 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:52.946146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 19:58:52.947425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:52.950885 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 503/1014] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:52.952722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2539025-75a3-4978-b8fd-68094425baca None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:52.968643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f284-d126-4613-a893-c994051472aa None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.968933 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f284-d126-4613-a893-c994051472aa None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.969212 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f284-d126-4613-a893-c994051472aa None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.970640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 504/1015] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:52.975701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:52.975992 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:52.976594 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:52.994007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:52.994884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:52.998309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:53.005622 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:53.063863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2539025-75a3-4978-b8fd-68094425baca None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:53.068969 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 505/1016] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:53.091188 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:53.099120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:53.100074 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:53.100359 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:53.100633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:53.101659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] RBAC: Adding query filter params (name=compute) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:53.101963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:53.103530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:53.112981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 512/1017] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:53.114927 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:53.197554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192d55e-d361-4f23-9901-9da94d12dab8 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:53.230634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec7b0-a65d-4a36-bb67-01c9b276fcbd None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:53.232592 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:53.235804 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:53.236504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:53.236824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:53.237103 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:53.237855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:53.239303 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:53.256593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 506/1018] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:58:53 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 19:58:53.286291 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:53.287024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:53.287308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:53.287579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:53.288311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] RBAC: Adding query filter params (type=compute) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:53.288617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:53.290042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509998ef-c1b8-497c-94c9-9ed17aa26080 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:53.301710 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 513/1019] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 19:58:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:53.303409 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:53.309339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:53.418931 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e097-6b64-4ffb-9957-f93fb14d811c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:53.458235 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:53.458892 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:53.459184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:53.459466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:53.460245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:53.461621 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ed2c4-1db1-4346-b966-6cedca29716a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:53.483925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 507/1020] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:54.320073 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487bca1-2bf8-44c6-b93f-7b64c0dd9a47 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:54.320607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487bca1-2bf8-44c6-b93f-7b64c0dd9a47 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:54.320607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487bca1-2bf8-44c6-b93f-7b64c0dd9a47 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:54.322045 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 514/1021] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:54.327921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:54.328359 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:54.328554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:54.345365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:54.346578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:54.409476 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:54.430362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 508/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:54.457239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487bca1-2bf8-44c6-b93f-7b64c0dd9a47 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:54.562635 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487bca1-2bf8-44c6-b93f-7b64c0dd9a47 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:54.597250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:54.597994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:54.598280 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:54.598564 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:54.599777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:54.601555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7b34-5ecc-41f2-a48f-4e545e0bb271 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:54.603483 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 515/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:54.609148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:54.724910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8faca-870d-4c93-bf3f-38acb4701bb4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:54.761163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:54.761850 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:54.762197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:54.762481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:54.763283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:54.764724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf2f45-5871-4ae2-aca6-a60991aeb4d7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:54.787013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 509/1024] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:58:54 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:58:55.520723 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834ce2-9dba-4977-8a46-fcb3f08faa6c None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.521248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834ce2-9dba-4977-8a46-fcb3f08faa6c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.521319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15834ce2-9dba-4977-8a46-fcb3f08faa6c None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.522846 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 516/1025] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:55.528528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.528986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.529058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.546222 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:55.547425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:55.585671 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:55.626826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 510/1026] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:55.645172 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15834ce2-9dba-4977-8a46-fcb3f08faa6c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:55.678211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:55.753311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15834ce2-9dba-4977-8a46-fcb3f08faa6c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:55.787850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:55.788571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.788847 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.789118 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] PATH_INFO: `/v3/services/image` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.789772 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:55.791199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-6210c310-c31f-43eb-8daf-7bf6d6e1947b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:55.802781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:55.803643 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:55.804382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:55.806778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 517/1027] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:58:55 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:55.810502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:55.813442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a75e-44cc-485b-8056-7a3827fc583a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.813727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a75e-44cc-485b-8056-7a3827fc583a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.814012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a75e-44cc-485b-8056-7a3827fc583a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.815398 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 518/1028] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:55.820423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.820712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.820993 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.838742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:55.839924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:55.911059 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 519/1029] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:55.922141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1993e-c7ae-431a-9b06-0b5af8689855 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:55.934231 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:55.959826 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:55.962031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:55.962903 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:55.963642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:55.963642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:55.964201 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] RBAC: Adding query filter params (name=image) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:55.964531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:55.965979 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:55.972278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 511/1030] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:55.977786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.017069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.044923 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5e9cb-0fab-4fc3-b254-09cb612ad2dc None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.081703 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.082526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.082839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.083117 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.085724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea3ad-1203-45f1-b0c3-2262c251db84 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.093915 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:56.102603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:56.103717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:56.104502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 520/1031] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:58:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:56.109712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.132249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.132928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.133237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.133495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.134391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:56.134724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.136111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.141620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 512/1032] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:56.147395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.195555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.212296 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c3ba9-0c80-4f9b-a092-5d02bbf7e064 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.248894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.249580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.249941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.250239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.251020 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:56.251353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.252713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.254220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.257526 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5006be-97c3-4180-b9c8-67028f5179a1 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.263553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 521/1033] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:56.269008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.298923 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.299537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.299831 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.300112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.300912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] RBAC: Adding query filter params (interface=public, service_id=f501ddb2a68a4fd88e85df2490bc0858, region_id=RegionOne) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:56.301234 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.302624 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.308151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 513/1034] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/endpoints?service_id=f501ddb2a68a4fd88e85df2490bc0858&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:56.313565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.376531 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff1e66-d8bc-44d5-a887-6ba808fc7cb1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.413108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.413937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.414221 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.414494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.424000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980be52e-b6b2-4438-8c55-e56d4f74d830 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.425236 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.426704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.433046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:56.445201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:56.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:56.447089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:56.447089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:56.447089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:56.447089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:56.447089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 522/1035] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:56.452231 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.467006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.467682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.467965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.468229 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.468919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.470297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.477609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 514/1036] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 19:58:56.566473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64e9dc-6644-47ba-a7c0-3d4cbf8d4772 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.605867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.606561 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.606886 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.607163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.607905 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:56.608208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.609627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.630994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 523/1037] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:56.632528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.666713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.742715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cafc7-0d26-4986-910c-bdcc51891e0c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.778993 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.779794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.780073 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.780352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.787909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.789358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:58:56.805973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:56.806893 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:56.807768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 515/1038] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:56.813292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:56.874314 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:56.924778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61efd5-9346-4b8c-aa7e-659aca8751cf None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:56.961539 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:56.962297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:56.962586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:56.962891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:56.963743 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:56.964061 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:56.965510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae51507-ee8b-40fc-a2e2-3b5c9e87dc34 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:56.984357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 524/1039] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:56.989963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.075900 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2315-c2c9-4c72-9cf9-d997e370fc4c None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.076249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2315-c2c9-4c72-9cf9-d997e370fc4c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.076523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2315-c2c9-4c72-9cf9-d997e370fc4c None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.078769 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 525/1040] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:58:57.083193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.083334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.083480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.083978 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.097325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9fa70-6481-4cfe-a1ca-b53086927878 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.102129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:57.103719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:57.132577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.133240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.133525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.133800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.174191 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 526/1041] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:58:57.197412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.205851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.207372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.247330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.301999 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.308234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a10cc8-5c60-4a85-b510-b2f8f5bf4d49 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.322059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 516/1042] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:58:57.323428 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.345289 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.346103 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.346659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.346659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.357615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:58:57.366758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:57.367598 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:58:57.368388 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:57.369023 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 527/1043] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:57.374177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.430184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7a9b-c548-4f2a-b9b6-877b72ee709d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.465477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.466284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.466571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.466878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.478468 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.479524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de97b5-b63e-4477-a558-5d8be7865083 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.479977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.487252 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:58:57.498218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:57.499121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:57.500652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:58:57.500652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:58:57.500652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:58:57.500652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:57.500652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 517/1044] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:57.504981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.517438 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.518120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.518421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.518716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.519465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:57.519785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.521165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.534290 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 528/1045] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:57.535310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.554540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.618558 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184602-6daa-4f04-b78d-9fa7673ac822 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.656058 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f40634-870d-4738-bd40-1dff2da1bdc0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.662381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.663097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.663781 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.664060 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.664787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:57.665094 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.667209 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.684977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 518/1046] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:57.685726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.693880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.694805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.695091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.695793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] PATH_INFO: `/v3/users/f9cb9ed2118146839b9312cb2a1f1b42` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.710886 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] RBAC: Authorizing `identity:get_user(user_id=f9cb9ed2118146839b9312cb2a1f1b42)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.712420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.714285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 529/1047] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/users/f9cb9ed2118146839b9312cb2a1f1b42 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:57.719908 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.750745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.793771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.797449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aa7f9-2880-4593-903e-750097d15a63 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.829137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288f1eb-6e6b-423b-a9b3-9ebc12f46e69 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:57.839746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.840856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.841138 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.841411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.848505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.849960 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.863895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:58:57.864412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:57.865190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:58:57.866002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:58:57.866387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:57.866387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:57.866387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:57.866558 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 519/1048] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:58:57.871481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:57.938862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:57.940259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:57.968498 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:57.977046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344773d4-977b-4083-a482-2adb11af18b7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:58.014503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:58.015305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.015592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.015870 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.016667 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:58.017637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:58.018427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:58.036329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 520/1049] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:58.037854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:58.048532 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 530/1050] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:58:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 19:58:58.054250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:58.063486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:58.150503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd8a1-e800-43fd-bbc2-1d9b5904bdc3 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:58.157333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3a255-1f94-4ffa-9d8b-36ed241abab3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:58.184232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:58.188302 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:58.190150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.190382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.190654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.191506 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] RBAC: Adding query filter params (role.id=f0bafde455fe40bdb5710fedfa27fcda, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:58.191817 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:58.193270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:58.196262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:58.197199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.197488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.197777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.199007 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:58.199906 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 521/1051] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:58 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f0bafde455fe40bdb5710fedfa27fcda => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:58.200562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8895f-3e9f-4664-a7f7-d3b2e4a33217 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:58.202461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 531/1052] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:58:58 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:58.208668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:58.310600 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:58.329541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d896-d00d-4855-a183-f9dae481c28f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:58.367939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:58.368675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.368939 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.369224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.370069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=4c7deb2d807d4d9397f9e0c87c579499, user.id=f9cb9ed2118146839b9312cb2a1f1b42) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:58.370384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:58.371932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46605-d3dc-4556-b465-b8745aa20727 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:58.378569 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 522/1053] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:58:58 2022] GET /identity/v3/role_assignments?user.id=f9cb9ed2118146839b9312cb2a1f1b42&scope.project.id=4c7deb2d807d4d9397f9e0c87c579499&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:58.701851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27294-9a3e-4525-a324-f263e835a007 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.702386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27294-9a3e-4525-a324-f263e835a007 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.702386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27294-9a3e-4525-a324-f263e835a007 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.704052 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 532/1054] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:58:58.709477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.709883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.710046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.727733 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:58:58.728936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:58:58.800015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 523/1055] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:58:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:58:58.822841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27294-9a3e-4525-a324-f263e835a007 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:58.937352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27294-9a3e-4525-a324-f263e835a007 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:58.980104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:58.980911 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:58.981197 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:58.981472 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] PATH_INFO: `/v3/services/image` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:58.982135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:58.983569 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:58:58.995798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:58:58.996712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:58:58.997647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 533/1056] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 19:58:58 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:58:59.003058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:59.084054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:59.108515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca0c9d-4b7a-472d-92b3-215d03a20c8d None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:59.144019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:59.144706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:59.144977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:59.145251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:59.145956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] RBAC: Adding query filter params (name=image) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:59.146274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:59.147787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:59.157297 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 524/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:58:59.158514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:59.218155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:59.265736 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ae62-f509-4ef4-b152-f4573a961227 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:59.302087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:59.302799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:59.303086 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:59.303363 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:59.304078 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:58:59.304389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:59.305857 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cbb41-4569-4720-9d3a-3f11ef64c0b3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:59.312784 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 534/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:58:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:58:59.317734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:58:59.422602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2572-e1dd-4184-b269-fd14b4b851bc None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:58:59.459078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:58:59.459748 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:58:59.460032 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:58:59.460309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:58:59.461084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:58:59.462524 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769e7e0-7a88-4af8-9c0b-80a616fbb12b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:58:59.476980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:58:59.491115 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 525/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 19:58:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:00.418705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7886-c1bc-45b1-a0e3-097e3610b4d9 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.419245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7886-c1bc-45b1-a0e3-097e3610b4d9 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.419245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7886-c1bc-45b1-a0e3-097e3610b4d9 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.420636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 535/1060] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:00.426599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5ec4-af59-4182-9fbe-bd5ef554d9e6 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.427116 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5ec4-af59-4182-9fbe-bd5ef554d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.427186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a5ec4-af59-4182-9fbe-bd5ef554d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.445714 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-587a5ec4-af59-4182-9fbe-bd5ef554d9e6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:00.447040 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-587a5ec4-af59-4182-9fbe-bd5ef554d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:00.525395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 526/1061] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:00.548361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7886-c1bc-45b1-a0e3-097e3610b4d9 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:00.624928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b05f1-7fe4-4845-8635-7ecdf5550ae5 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.627946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b05f1-7fe4-4845-8635-7ecdf5550ae5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.627946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b05f1-7fe4-4845-8635-7ecdf5550ae5 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.627946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 527/1062] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:00.633031 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.633319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.633599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.651977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:00.653219 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:00.662003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7886-c1bc-45b1-a0e3-097e3610b4d9 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:00.686950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:00.701775 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:00.702658 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.703084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.703366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.714844 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:00.723230 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:00.724121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:00.724901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 536/1063] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:59:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:00.726864 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 528/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:59:00.731251 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:00.749047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:00.806054 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:00.843504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc88e4-2abd-4cf0-b14f-5e39b1fa501d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:00.855026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b71aa6-5c41-492a-93c9-f2277ae89055 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:00.879330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:00.880064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.880299 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.880577 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.881337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:00.881652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:00.883081 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:00.892091 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 537/1065] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:59:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:59:00.892975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:00.893785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:00.894070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:00.894349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:00.898011 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:00.906335 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:00.915305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:00.916165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:00.916918 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 529/1066] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:59:00.923089 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:00.946719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.011368 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d799-e393-49ac-902b-cf700dd0d81a None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.035218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d345f80-c100-4041-bcbe-d97cd80b9de7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.049811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.054662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.055487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.055822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.056106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.067088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.068557 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.074915 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.075602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.075882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.076159 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.076909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:01.077218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.078585 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.087383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 530/1067] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:01.087668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:01.088665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:01.091479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:59:01.091479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:01.091479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:01.091479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:01.091479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 538/1068] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:59:01.093354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.094563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.188579 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.194642 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e04ff-1cc3-4b66-9c5a-4658a23aa0b9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.203840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9675-202e-454b-99a2-e0ab3b0cbb0e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.229693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.230360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.230633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.230951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.231848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:01.231951 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.233318 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.243555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.244544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.244834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.245112 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] PATH_INFO: `/v3/users/f9cb9ed2118146839b9312cb2a1f1b42` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.250226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 539/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:01.250376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] RBAC: Authorizing `identity:get_user(user_id=f9cb9ed2118146839b9312cb2a1f1b42)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.250376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.250376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 531/1070] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/users/f9cb9ed2118146839b9312cb2a1f1b42 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:59:01.255003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.255119 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.302367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.363538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387010e-8ed7-41f0-94c0-7677d55eccd0 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.368533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521c871-aee0-460a-90d1-1796ab75a2e8 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.402590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.403496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.403779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.404055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.404974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.405213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.405783 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.406066 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.406342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.406652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.413768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 532/1071] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:01.414178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.418278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.419785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:59:01.435646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:01.436506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 540/1072] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:01.442880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.462149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.523816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeee86-f540-43c8-b93f-1fcd52fa500b None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.538661 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.547734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83961-44eb-4541-a677-d2c34ef1569f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.561909 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.562868 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.563150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.563432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499/users/f9cb9ed2118146839b9312cb2a1f1b42/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.565552 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7deb2d807d4d9397f9e0c87c579499, user_id=f9cb9ed2118146839b9312cb2a1f1b42, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.567069 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.584760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 533/1073] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:59:01 2022] PUT /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499/users/f9cb9ed2118146839b9312cb2a1f1b42/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:59:01.588102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.589099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.589588 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.590039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.591137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:01.591631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.593315 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b752017-f984-468e-bec8-6b563f561427 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.615412 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 541/1074] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:01.621279 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.735911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740bd58-deff-4e03-85ba-9b042738b726 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.767726 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af31c-03bd-42cc-8d3d-3b7512ee22b1 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.768146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af31c-03bd-42cc-8d3d-3b7512ee22b1 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.768296 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141af31c-03bd-42cc-8d3d-3b7512ee22b1 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.769651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 542/1075] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:01.774946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.775567 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.775760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.775853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.776034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.776127 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.776308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.789488 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.791024 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.796515 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:01.797722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:01.808788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:01.809660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:01.810474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:59:01.810474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:01.810474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:01.810474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:01.810474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 534/1076] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:01.815499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.843837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.871136 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 543/1077] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:01.893673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:01.897851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:01.937373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916196-7099-4cbe-8b84-ed2d0daa2405 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:01.974322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:01.975034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:01.975312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:01.975586 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:01.976636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:01.976944 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:01.978837 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:01.991921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 535/1078] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:01.997577 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:02.005320 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796f8bb-e689-4994-bcac-6fa029a80b20 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.042087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.043104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.043386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.043664 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.094745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:02.113278 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54684927-840f-404c-badd-b4dc6e97b2bf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.116324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.117576 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.121093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:02.150707 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.151535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.151816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.152088 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.159317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.160767 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:59:02.174542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:02.175383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:02.176820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 536/1079] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:59:02.181706 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:02.231003 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 544/1080] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:02.232965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:02.290365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a81c-a237-4952-b494-1aa3d5285447 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.331770 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.332442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.332723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.333386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.334196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:02.334814 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.336726 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.345170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1d227-e60e-4d54-be38-d3c74412682e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.347620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:02.357768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 537/1081] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:02.359082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:02.362730 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:02.386553 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.387502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.387786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.388057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.398758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.400824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:02.419922 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:02.421222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:02.422647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:59:02.422647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:02.422647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:02.422647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:02.422647 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 545/1082] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:02.426934 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:02.467531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f5729-64f5-4e4b-80c1-2235c62b1476 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.504781 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.505935 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.506366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.506818 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/f0bafde455fe40bdb5710fedfa27fcda` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.509489 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=a5b17626f37949c3adb553d9d4fb72fe, role_id=f0bafde455fe40bdb5710fedfa27fcda)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.511150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef4ec2-ef2b-4afa-9877-45300caef0c5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.527208 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 538/1083] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:59:02 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/a5b17626f37949c3adb553d9d4fb72fe/roles/f0bafde455fe40bdb5710fedfa27fcda => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:59:02.531389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d13b1-0f1d-474d-bafc-91a174a59ab2 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:02.572805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:02.573811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:02.574283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:02.574739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:02.575736 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:02.576283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:02.577885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928353-5b3a-490d-8467-f6dc480772a1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:02.592780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 546/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:59:03.818443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b781-1c4a-4c81-be66-2baf25390d2f None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:03.819002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b781-1c4a-4c81-be66-2baf25390d2f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:03.819002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b781-1c4a-4c81-be66-2baf25390d2f None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:03.820592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 539/1085] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:03.825750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:03.826129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:03.826313 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:03.843362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:03.844547 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:03.855974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:03.916654 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 547/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:03.940344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735b781-1c4a-4c81-be66-2baf25390d2f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.006661 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:04.047283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735b781-1c4a-4c81-be66-2baf25390d2f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.083538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:04.084336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.084631 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.084877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.095654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:04.103727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:04.104581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:04.105349 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 540/1087] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:04.111177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.215387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23072f4-918a-4ddc-a48d-6f0867ee6d0a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.250568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:04.251265 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.251544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.251821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.252564 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:04.252866 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:04.254246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:04.263254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 548/1088] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:04.270309 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.378644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcfae3-ee2d-424b-98e4-15cfb5e14aca None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.402521 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:04.415016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:04.415976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.416259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.416529 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] PATH_INFO: `/v3/users/f9cb9ed2118146839b9312cb2a1f1b42` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.417759 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] RBAC: Authorizing `identity:get_user(user_id=f9cb9ed2118146839b9312cb2a1f1b42)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:04.419251 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb635-705c-4a7b-bad8-2b8ecc9cdcdd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:04.420900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 541/1089] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/users/f9cb9ed2118146839b9312cb2a1f1b42 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:04.426787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.438785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:04.530177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db0f6-0681-40d8-9e36-e5c2b4974ffb None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.567692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:04.568359 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.568639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.568910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.651109 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:04.652601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:04.662482 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:04.741354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a082bb-f683-4ae3-8347-d7fdb71ac837 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.741645 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a082bb-f683-4ae3-8347-d7fdb71ac837 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.741911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a082bb-f683-4ae3-8347-d7fdb71ac837 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.743496 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 542/1090] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 19:59:04.748588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.748881 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.749163 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.754382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 549/1091] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:04.760300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.766157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:04.767398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:04.836127 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 543/1092] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:04.859660 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59e8db-8921-44c2-96a5-ee8f1eccf9f0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.861729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.869461 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:04.894807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:04.895687 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:04.895960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:04.896233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:04.897455 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:04.898939 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:04.900737 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 550/1093] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:04.906668 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:04.963467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349be2-6d2d-4557-b467-b52accac0984 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:04.988308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:05.000866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.001687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.001966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.002243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.010752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7368a-0890-402a-95ef-55513f0f7903 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.013359 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:05.021609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:05.022699 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:05.023523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 544/1094] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 19:59:05.028794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.047038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.047709 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.047980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.048259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.049102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=4c7deb2d807d4d9397f9e0c87c579499, user.id=f9cb9ed2118146839b9312cb2a1f1b42) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:05.049419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.050904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.057122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 551/1095] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:04 2022] GET /identity/v3/role_assignments?user.id=f9cb9ed2118146839b9312cb2a1f1b42&scope.project.id=4c7deb2d807d4d9397f9e0c87c579499&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:59:05.135962 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e245d-6172-45cf-baef-ea226e5de11c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.174275 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.174995 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.175285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.175559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.176329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:05.176634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.178034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.187532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 545/1096] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 19:59:05.193693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.241929 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:05.302425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb928240-a750-4aab-a9c9-9e411d7cdcb3 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.337107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.337924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.338212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.338489 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.349448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.351232 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:05.369451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:05.370324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:05.371210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:59:05.371210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:05.371210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:05.371210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:05.371210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 552/1097] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:05.376654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.426655 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:05.485412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51009e1-1d94-4589-b7ee-4c06add92ecd None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.520571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.521249 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.521537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.521812 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.522574 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:05.522946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.524295 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.536704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 546/1098] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:05.542504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.645316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:05.655072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449342d-0562-4c34-b4ac-5288cba21816 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.689632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.690360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.690646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.690977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.698165 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.699653 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 19:59:05.713760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:05.714651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:05.715554 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 553/1099] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:05.721011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.828085 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9374-e0b2-427c-85a6-19dbbb52be8f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:05.830454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:05.864294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:05.864940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:05.865221 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:05.865493 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:05.866319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:05.866625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:05.868215 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:05.885746 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 547/1100] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:05.891619 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:05.999835 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462e532-6d95-44a1-96c5-3ff0faa8ffb7 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:06.035805 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:06.036449 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:06.036728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:06.036994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:06.058361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:06.106050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:06.107673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:06.210146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 554/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:06.216030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:06.321745 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85577-36dc-42cd-8aac-3e8fb3fa6d56 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:06.357128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:06.357935 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:06.358226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:06.358505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:06.368684 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:06.370149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:06.388363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:06.389228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:06.390133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 19:59:06.390133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:06.390133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 19:59:06.390133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:06.390133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 548/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:06.395628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:06.449487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:06.499716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bb22-9032-4dee-b9b4-f2510b3a367f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:06.533997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:06.534670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:06.534989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:06.535270 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:06.536004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:06.536311 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:06.537699 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:06.549242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 555/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 19:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:06.555238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:06.571321 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:06.663578 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee244-3b28-418e-877e-d11c2d185aa9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:06.698717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:06.699525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:06.699809 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:06.700086 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:06.707029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:06.708490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 19:59:06.722425 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:06.723342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:06.724161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 549/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 19:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:06.729999 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:06.830719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4618-d69e-4d92-a0fa-4b7cfb6f9efc None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:06.843918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:06.866933 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:06.867594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:06.867918 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:06.868300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:06.869088 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:06.869396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:06.871416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4b265-23dd-441f-8c7d-fd3f675ed787 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:06.885778 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 556/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 19:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:06.892012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:06.972656 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:06.999169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5af0b-87bc-4079-b4ca-71ffafe9d2f5 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:07.034718 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:07.035397 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:07.035675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:07.035947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:07.036771 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] RBAC: Adding query filter params (role.id=f0bafde455fe40bdb5710fedfa27fcda, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=a5b17626f37949c3adb553d9d4fb72fe) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:07.037078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:07.038510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749711c3-f568-4497-82b3-383d7c555351 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:07.044523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 550/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:06 2022] GET /identity/v3/role_assignments?user.id=a5b17626f37949c3adb553d9d4fb72fe&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f0bafde455fe40bdb5710fedfa27fcda => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:07.294467 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d84e-e489-4533-a742-5a7dc66d081d None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:07.294994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d84e-e489-4533-a742-5a7dc66d081d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:07.295087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39d84e-e489-4533-a742-5a7dc66d081d None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:07.296447 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 557/1107] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:07.302404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:07.302792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:07.303101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:07.320653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:07.322044 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:07.391499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 551/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:07.416423 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d84e-e489-4533-a742-5a7dc66d081d None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:07.521915 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39d84e-e489-4533-a742-5a7dc66d081d None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:07.557958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:07.558715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:07.559005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:07.559277 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:07.560498 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:07.561945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf51734-08fa-43cb-8aa1-51677b76d059 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:07.563757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 558/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:07.569670 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:07.639900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:07.678935 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ee04e-97e0-452d-a217-6219c2bfd0c6 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:07.717761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:07.718442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:07.718753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:07.719020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:07.719730 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:07.721193 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62efd6-0434-4ade-a921-db226cd0b316 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:07.743774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 552/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:59:07 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:09.980083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119425-4bfa-466f-952a-521aa795b8cf None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:09.980614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119425-4bfa-466f-952a-521aa795b8cf None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:09.980614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119425-4bfa-466f-952a-521aa795b8cf None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:09.982667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 559/1111] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:09.991774 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:09.992175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:09.992415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:10.011010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:10.012322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:10.084604 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 553/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:10.108634 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c119425-4bfa-466f-952a-521aa795b8cf None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:10.154752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:10.230041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c119425-4bfa-466f-952a-521aa795b8cf None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:10.267181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:10.267977 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:10.268262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:10.268539 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] PATH_INFO: `/v3/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:10.270146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] RBAC: Authorizing `identity:get_role(role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:10.271558 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:10.272930 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 560/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:10 2022] GET /identity/v3/roles/b56351c81b57421dad2ef84f35fe7238 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:10.279241 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:10.337284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:10.383016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8503181-b34b-4d6f-9dd8-f70e49d7b058 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:10.418259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:10.419160 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:10.419451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:10.419723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] PATH_INFO: `/v3/users/3ea2c515e720407b96653db58378bcf0` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:10.433224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] RBAC: Authorizing `identity:get_user(user_id=3ea2c515e720407b96653db58378bcf0)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:10.434678 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:10.436367 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 554/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:10 2022] GET /identity/v3/users/3ea2c515e720407b96653db58378bcf0 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:10.442307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:10.547353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d31b8-1001-4669-9fa2-d9136b589905 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:10.556885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:10.584435 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:10.585082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:10.585358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:10.585633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:10.654839 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:10.656304 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:10.771028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 561/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:10.778096 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:10.891388 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17634a-1147-41a1-b55e-e267a7dfcd0a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:10.905617 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:10.931002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:10.931871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:10.932148 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:10.932415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:10.933638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:10.935170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f62d96-09ac-47d0-b8ee-d3e92c7a6a35 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:10.936883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 555/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:10 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:10.946562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:10.957120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:11.061614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cafa44-5c00-46fb-b59c-b9ba481e2631 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:11.100811 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:11.101800 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:11.102107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:11.102504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:11.103350 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=4c7deb2d807d4d9397f9e0c87c579499, user.id=3ea2c515e720407b96653db58378bcf0) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:11.103688 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:11.105157 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f34f0-5d19-43d6-8d4f-ac4325c4552a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:11.110885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 562/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:10 2022] GET /identity/v3/role_assignments?user.id=3ea2c515e720407b96653db58378bcf0&scope.project.id=4c7deb2d807d4d9397f9e0c87c579499&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:13.282581 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baec7-6aaf-4596-a073-9fb29e913c74 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:13.283479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baec7-6aaf-4596-a073-9fb29e913c74 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:13.283479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983baec7-6aaf-4596-a073-9fb29e913c74 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:13.285752 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 556/1118] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:13.291413 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:13.291845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:13.291942 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:13.310022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:13.311276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:13.381781 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 563/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:13.404985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983baec7-6aaf-4596-a073-9fb29e913c74 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:13.514221 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983baec7-6aaf-4596-a073-9fb29e913c74 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:13.561410 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:13.562210 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:13.562495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:13.562802 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] PATH_INFO: `/v3/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:13.564525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] RBAC: Authorizing `identity:get_role(role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:13.565925 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:13.567361 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 557/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:13 2022] GET /identity/v3/roles/b56351c81b57421dad2ef84f35fe7238 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:13.574638 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:13.578001 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:13.682484 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a71e-499d-4338-9561-660bcb72f9eb None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:13.718520 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:13.719421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:13.719708 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:13.719986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] PATH_INFO: `/v3/users/3ea2c515e720407b96653db58378bcf0` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:13.721319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ea2c515e720407b96653db58378bcf0)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:13.722826 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:13.724465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 564/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:13 2022] GET /identity/v3/users/3ea2c515e720407b96653db58378bcf0 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:13.730966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:13.783285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:13.843554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ef5c2-ceb4-4962-873e-24f54cbd4eca None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:13.879420 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:13.880266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:13.880541 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:13.880794 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:13.881990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:13.883502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6978f3-5bc6-40a8-a8a2-29fc59d42619 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:13.885180 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 558/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:13 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:13.891354 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:13.965162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:14.002970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602f0c-38e1-45e7-b33c-73ee864e0de1 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:14.038843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:14.039730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:14.040082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:14.040364 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499/users/3ea2c515e720407b96653db58378bcf0/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:14.042800 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7deb2d807d4d9397f9e0c87c579499, user_id=3ea2c515e720407b96653db58378bcf0, role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:14.044254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9785844-74cf-4898-8fbb-b570a7b9290a None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:14.059663 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 565/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:59:13 2022] PUT /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499/users/3ea2c515e720407b96653db58378bcf0/roles/b56351c81b57421dad2ef84f35fe7238 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:59:16.235422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2e7c-3f0a-4a20-a54f-f2a9c0588819 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:16.236266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2e7c-3f0a-4a20-a54f-f2a9c0588819 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:16.236266 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2e7c-3f0a-4a20-a54f-f2a9c0588819 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:16.238792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 559/1124] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:16.249345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:16.249793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:16.249921 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:16.270779 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:16.271989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:16.358765 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 566/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:16.382840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2e7c-3f0a-4a20-a54f-f2a9c0588819 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:16.490352 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2e7c-3f0a-4a20-a54f-f2a9c0588819 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:16.507122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:16.526518 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:16.527403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:16.527688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:16.527960 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] PATH_INFO: `/v3/roles/b56351c81b57421dad2ef84f35fe7238` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:16.529588 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] RBAC: Authorizing `identity:get_role(role_id=b56351c81b57421dad2ef84f35fe7238)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:16.531050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:16.532417 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 560/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:16 2022] GET /identity/v3/roles/b56351c81b57421dad2ef84f35fe7238 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:16.538397 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:16.603366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:16.648312 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd96b5-bf31-4db4-bb5e-7bfdf03874b7 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:16.684568 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:16.685454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:16.685746 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:16.686027 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] PATH_INFO: `/v3/users/3ea2c515e720407b96653db58378bcf0` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:16.687366 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] RBAC: Authorizing `identity:get_user(user_id=3ea2c515e720407b96653db58378bcf0)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:16.688825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:16.690480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 567/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:16 2022] GET /identity/v3/users/3ea2c515e720407b96653db58378bcf0 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:16.697151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:16.813312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70fc78-133a-45d3-8fec-11389186911f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:16.854224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:16.854920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:16.855205 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:16.855485 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:16.912257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:16.931741 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:16.933202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:17.036050 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 561/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:17.042539 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:17.169263 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8b4e7-3a71-480d-ae71-1d80ef9a0c84 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:17.196438 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:17.210085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:17.211504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:17.211900 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:17.212187 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] PATH_INFO: `/v3/projects/4c7deb2d807d4d9397f9e0c87c579499` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:17.213406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=4c7deb2d807d4d9397f9e0c87c579499)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:17.214897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570692a1-928d-4b18-beb6-4e83003a6fc4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:17.216611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 568/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:17 2022] GET /identity/v3/projects/4c7deb2d807d4d9397f9e0c87c579499 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:17.223453 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:17.319959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:17.338141 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db36023-2c7b-49e6-9bff-bb408209f0df None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:17.374178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:17.374861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:17.375143 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:17.375415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:17.376272 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] RBAC: Adding query filter params (role.id=b56351c81b57421dad2ef84f35fe7238, scope.project.id=4c7deb2d807d4d9397f9e0c87c579499, user.id=3ea2c515e720407b96653db58378bcf0) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:17.376584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:17.378011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ec8b4-9aec-484e-9ae5-4163afee7389 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:17.384192 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 562/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:17 2022] GET /identity/v3/role_assignments?user.id=3ea2c515e720407b96653db58378bcf0&scope.project.id=4c7deb2d807d4d9397f9e0c87c579499&role.id=b56351c81b57421dad2ef84f35fe7238 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:19.626624 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6ac0-ad62-49f1-96c2-f91a8732a4af None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:19.627186 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6ac0-ad62-49f1-96c2-f91a8732a4af None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:19.627287 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf6ac0-ad62-49f1-96c2-f91a8732a4af None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:19.628636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 569/1131] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:19.635871 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:19.636564 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:19.637196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:19.660852 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:19.662048 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:19.745189 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 563/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:19.768542 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6ac0-ad62-49f1-96c2-f91a8732a4af None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:19.882456 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf6ac0-ad62-49f1-96c2-f91a8732a4af None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:19.917690 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:19.918471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:19.918787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:19.919056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:19.920277 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:19.921714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c07c-1409-49ee-8b58-fc9ac0f1a3ae None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:19.923357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 570/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:19.929977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:20.018832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:20.041211 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170c388-edf9-4f75-b8d6-f444e626fd6e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:20.093551 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:20.094594 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:20.095104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:20.095488 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:20.096582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:20.098887 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a35903-0f32-4aeb-a5c4-cb54a6426a89 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:20.129550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 564/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:59:19 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:22.357639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90bed-e50b-402e-9810-91965af6e164 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:22.358225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90bed-e50b-402e-9810-91965af6e164 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:22.358225 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90bed-e50b-402e-9810-91965af6e164 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:22.359651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 571/1135] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:22.366030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:22.366741 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:22.367035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:22.390725 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:22.391972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:22.464318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 565/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:22.501018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90bed-e50b-402e-9810-91965af6e164 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:22.576576 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:22.626210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90bed-e50b-402e-9810-91965af6e164 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:22.663331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:22.664135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:22.664422 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:22.664702 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] PATH_INFO: `/v3/domains/default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:22.666037 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:22.667528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3723784-e4d5-43d0-8f94-13667942296b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:22.669176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 572/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 19:59:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:22.675196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:22.737164 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:22.779772 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ffa4f-e856-46ba-a61d-3478d5b2b284 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:22.815651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:22.816665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:22.817130 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:22.817587 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:22.818760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:22.821077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb91159-c42a-4054-b88f-fa9355b5c716 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:22.843491 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 566/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:59:22 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:25.080344 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bb53-79b1-495a-9887-381e0e4a5740 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.081145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bb53-79b1-495a-9887-381e0e4a5740 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.081145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bb53-79b1-495a-9887-381e0e4a5740 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.083322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 573/1139] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:25.089777 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.090555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.090727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.113170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:25.114391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:25.189391 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 567/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:25.227625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bb53-79b1-495a-9887-381e0e4a5740 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:25.347163 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bb53-79b1-495a-9887-381e0e4a5740 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:25.377140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:25.383326 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:25.384122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.384414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.384693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.395381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:25.403124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:25.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:25.405049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 574/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:25.411181 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:25.463178 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:25.521292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95db03-6988-4d01-8e2e-b7f7f7e53178 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:25.558550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:25.559242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.559523 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.559796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.560536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:25.560844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:25.562220 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:25.570454 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 568/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:25.576886 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:25.688127 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570b53-6a13-4b54-b5ad-fe0b6016f35c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:25.723228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:25.724102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.724386 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.724661 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] PATH_INFO: `/v3/users/8205a03446c440e58afa1c01d6d750c1` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.738965 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=8205a03446c440e58afa1c01d6d750c1)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:25.740443 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:25.742094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 575/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:25 2022] GET /identity/v3/users/8205a03446c440e58afa1c01d6d750c1 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:25.751243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:25.859534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab86c0-1e73-4d02-8e56-7d666894080d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:25.868368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:25.896277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:25.896854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:25.897152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:25.897430 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:25.971477 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:25.972955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:26.075623 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 569/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:26.081991 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:26.145757 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:26.199525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e948f38-6d9b-4da0-ae85-de6a535df5a4 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:26.242787 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:26.244222 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:26.245093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:26.245375 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] PATH_INFO: `/v3/projects/2ec74824b33141869400866e42ac3150` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:26.246677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] RBAC: Authorizing `identity:get_project(project_id=2ec74824b33141869400866e42ac3150)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:26.248188 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137016ba-77af-4f09-98c1-549ad7603376 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:26.251105 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 576/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:26 2022] GET /identity/v3/projects/2ec74824b33141869400866e42ac3150 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:26.257413 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:26.267862 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:26.366593 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73ad3-c00b-44ad-ac3e-54fe48b8a5c7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:26.404727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:26.405380 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:26.405668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:26.405947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:26.406813 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=2ec74824b33141869400866e42ac3150, user.id=8205a03446c440e58afa1c01d6d750c1) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:26.407134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:26.408584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a776d-0594-4b01-b944-7ecb05a652db None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:26.414334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 570/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:26 2022] GET /identity/v3/role_assignments?user.id=8205a03446c440e58afa1c01d6d750c1&scope.project.id=2ec74824b33141869400866e42ac3150&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:28.606771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d7f1-f533-4889-a3a5-9df090b21c60 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:28.607696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d7f1-f533-4889-a3a5-9df090b21c60 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:28.607696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d7f1-f533-4889-a3a5-9df090b21c60 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:28.610177 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 577/1147] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:28.620913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:28.621685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:28.621970 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:28.643883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:28.645737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:28.716505 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 571/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:28.749237 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5d7f1-f533-4889-a3a5-9df090b21c60 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:28.864307 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5d7f1-f533-4889-a3a5-9df090b21c60 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:28.882880 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:28.905804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:28.906628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:28.906945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:28.907224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:28.918591 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:28.926272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:28.927336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:28.928285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 578/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:28.934169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:28.937516 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:29.043386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdaa58-3b3f-4d5b-b850-89dd71e2bfd3 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:29.081558 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:29.082223 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:29.082506 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:29.082820 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:29.083570 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:29.083877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:29.085264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:29.093682 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 572/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:29.099945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:29.209705 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f06159-e342-4e33-868a-6607595deef8 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:29.245659 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:29.246529 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:29.246848 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:29.247123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] PATH_INFO: `/v3/users/8205a03446c440e58afa1c01d6d750c1` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:29.248433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] RBAC: Authorizing `identity:get_user(user_id=8205a03446c440e58afa1c01d6d750c1)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:29.249884 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:29.251522 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 579/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:29 2022] GET /identity/v3/users/8205a03446c440e58afa1c01d6d750c1 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:29.257659 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:29.323855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:29.364390 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73cd10-03e7-48eb-ad60-66e4ee60b58a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:29.403466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:29.404355 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:29.404637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:29.404913 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] PATH_INFO: `/v3/projects/2ec74824b33141869400866e42ac3150` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:29.406231 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] RBAC: Authorizing `identity:get_project(project_id=2ec74824b33141869400866e42ac3150)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:29.407714 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2f818-73f7-4c78-b42b-e40fa5ea1b16 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:29.409436 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 573/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:29 2022] GET /identity/v3/projects/2ec74824b33141869400866e42ac3150 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:29.418499 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:29.466368 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:29.535393 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84020413-c9b4-4efc-b047-a8b1d00cca48 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:29.567994 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:29.568882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:29.569166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:29.569448 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] PATH_INFO: `/v3/projects/2ec74824b33141869400866e42ac3150/users/8205a03446c440e58afa1c01d6d750c1/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:29.571466 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ec74824b33141869400866e42ac3150, user_id=8205a03446c440e58afa1c01d6d750c1, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:29.572926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca07272-ccc3-4d30-b6d9-112f67050e99 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:29.588780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 580/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:59:29 2022] PUT /identity/v3/projects/2ec74824b33141869400866e42ac3150/users/8205a03446c440e58afa1c01d6d750c1/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 19:59:31.781946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86441a3-105a-4aed-98ba-120eb12def27 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:31.782793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86441a3-105a-4aed-98ba-120eb12def27 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:31.782959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86441a3-105a-4aed-98ba-120eb12def27 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:31.785305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 574/1154] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:31.791892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:31.792607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:31.792748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:31.815254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:31.816441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:31.896827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 581/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:31.927822 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86441a3-105a-4aed-98ba-120eb12def27 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:32.042595 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86441a3-105a-4aed-98ba-120eb12def27 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:32.072049 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:32.081262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:32.082474 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:32.082946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:32.083362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:32.102151 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:32.109880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:32.110896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:32.116651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 575/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:32.117477 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:32.152528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:32.221141 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94003250-525b-4cc6-899c-888b33f01eaa None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:32.256869 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:32.257556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:32.257995 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:32.258345 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:32.259129 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:32.259429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:32.260830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:32.268986 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 582/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:32.275545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:32.392476 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b541a-9f70-4eef-8f09-29234f95cb1f None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:32.427902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:32.428708 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:32.428994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:32.429264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] PATH_INFO: `/v3/users/8205a03446c440e58afa1c01d6d750c1` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:32.430565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] RBAC: Authorizing `identity:get_user(user_id=8205a03446c440e58afa1c01d6d750c1)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:32.432019 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:32.433688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 576/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:32 2022] GET /identity/v3/users/8205a03446c440e58afa1c01d6d750c1 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:32.439861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:32.545571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:32.549621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fc1d-b07f-4b56-b5c2-0e164f52e8c9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:32.584452 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:32.585098 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:32.585383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:32.585657 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:32.656421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:32.657892 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:32.758601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:32.767596 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 583/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:32.776347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:32.843449 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:32.889482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adf5a2-9dbf-4d5b-9636-4096d6c09c84 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:32.936756 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:32.937632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:32.937921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:32.938200 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] PATH_INFO: `/v3/projects/2ec74824b33141869400866e42ac3150` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:32.939605 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] RBAC: Authorizing `identity:get_project(project_id=2ec74824b33141869400866e42ac3150)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:32.941065 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01916470-470b-4d30-aedc-56bff8ce3e37 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:32.943007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 577/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:32 2022] GET /identity/v3/projects/2ec74824b33141869400866e42ac3150 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:32.950235 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:33.061885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8c93-6e1b-4b43-86a4-dfcc3c2b8f17 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:33.099824 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:33.100479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:33.101077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:33.101358 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:33.102224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=2ec74824b33141869400866e42ac3150, user.id=8205a03446c440e58afa1c01d6d750c1) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:33.102543 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:33.104029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a079e4-4b6e-4fcd-a342-d8004fa7ab41 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:33.110059 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 584/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:32 2022] GET /identity/v3/role_assignments?user.id=8205a03446c440e58afa1c01d6d750c1&scope.project.id=2ec74824b33141869400866e42ac3150&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:35.364245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64c4-1171-489f-a4ff-872b4f817054 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:35.364898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64c4-1171-489f-a4ff-872b4f817054 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:35.364898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64c4-1171-489f-a4ff-872b4f817054 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:35.366156 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 578/1162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:35.372861 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:35.373574 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:35.373728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:35.401919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:35.403169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:35.464334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:35.482334 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 585/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:35.511562 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff64c4-1171-489f-a4ff-872b4f817054 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:35.621845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff64c4-1171-489f-a4ff-872b4f817054 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:35.651946 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:35.662342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:35.663136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:35.663418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:35.663693 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:35.733082 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:35.734533 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:35.840190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 579/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:35.849581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:35.949462 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566c54-7a05-42ea-a7d5-aab10b1357ec None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:35.987751 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:35.988785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:35.989077 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:35.989357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:35.998224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:35.999723 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-2d48015a-752a-4522-81b6-e1ae50778d04 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:36.014907 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:36.021445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:36.022469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 586/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 19:59:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:36.024376 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:36.052807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:36.128989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ad46-692c-4949-b53a-642b4ef427a4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:36.165833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:36.166498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:36.166826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:36.167097 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:36.167824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:36.168132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:36.169503 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a06de5-2bf6-4792-afcb-c28bd7cae7db None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:36.176796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 580/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 19:59:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:38.365348 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf47f1-2a77-4cab-8710-18356c69d48a None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:38.365910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf47f1-2a77-4cab-8710-18356c69d48a None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:38.365910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf47f1-2a77-4cab-8710-18356c69d48a None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:38.367846 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 587/1167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:38.374244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f200d-96c4-4965-8596-d55816c51807 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:38.374657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f200d-96c4-4965-8596-d55816c51807 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:38.374902 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f200d-96c4-4965-8596-d55816c51807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:38.402630 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-362f200d-96c4-4965-8596-d55816c51807 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:38.403857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-362f200d-96c4-4965-8596-d55816c51807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:38.476603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 581/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:38.505511 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf47f1-2a77-4cab-8710-18356c69d48a None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:38.562488 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:38.620419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf47f1-2a77-4cab-8710-18356c69d48a None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:38.660429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:38.661107 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:38.661392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:38.661673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:38.662425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:38.663852 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4cee-b6ec-49e8-a362-22c805d0c444 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:38.680617 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 588/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Thu May 19 19:59:38 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:40.923300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0f11-2511-4ce9-916b-d3e032282bea None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:40.924139 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0f11-2511-4ce9-916b-d3e032282bea None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:40.924292 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0f11-2511-4ce9-916b-d3e032282bea None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:40.926522 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 582/1170] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:40.934719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:40.935159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:40.935286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:40.953649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:40.954862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:41.024967 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 589/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 19:59:41.054697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0f11-2511-4ce9-916b-d3e032282bea None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:41.081339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:41.176084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0f11-2511-4ce9-916b-d3e032282bea None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:41.212240 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:41.213119 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:41.213395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:41.213668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] PATH_INFO: `/v3/domains/a7f738d16b5a44318fdb839ea54f93f5` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:41.229242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7f738d16b5a44318fdb839ea54f93f5)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:41.230785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a63290-ff08-47d2-97fb-791cdd846c8e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:41.232511 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 583/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 19:59:41 2022] GET /identity/v3/domains/a7f738d16b5a44318fdb839ea54f93f5 => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:41.239360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:41.283601 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:41.352825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56784-cb56-4ff4-993b-527c1e99aadf None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:41.389822 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:41.390482 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:41.390796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:41.391076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:41.391796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:41.393247 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81b3c0-3b45-4a02-b4a1-0b3f19211c53 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:41.424865 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 590/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 19:59:41 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:43.681839 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1748e3-4140-421f-9f64-20f3e79df451 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:43.682642 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1748e3-4140-421f-9f64-20f3e79df451 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:43.682869 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1748e3-4140-421f-9f64-20f3e79df451 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:43.685038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 584/1174] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:43.691563 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:43.692011 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:43.692149 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:43.716889 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:43.718095 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:43.789593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 591/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:43.814513 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1748e3-4140-421f-9f64-20f3e79df451 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:43.908445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:43.928986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1748e3-4140-421f-9f64-20f3e79df451 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:43.978536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:43.979442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:43.979727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:43.980002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] PATH_INFO: `/v3/domains/a7f738d16b5a44318fdb839ea54f93f5` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:43.981712 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7f738d16b5a44318fdb839ea54f93f5)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:43.984022 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d559e86-130d-456c-9882-29c2c5e84e7f None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:43.986751 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 585/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 19:59:43 2022] GET /identity/v3/domains/a7f738d16b5a44318fdb839ea54f93f5 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:43.992625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:44.020090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:44.099956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380a4e-38c1-4aab-b1f8-ddb28f4dad97 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:44.136460 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:44.137127 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:44.137414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:44.137695 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:44.138416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:44.139897 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22017e39-8e2f-4184-a612-0a82d4a37478 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:44.162726 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 592/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 19:59:43 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 19:59:46.399602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71bfce-32d0-4d45-8bc2-e9292eb2dde7 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:46.400498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71bfce-32d0-4d45-8bc2-e9292eb2dde7 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:46.400498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71bfce-32d0-4d45-8bc2-e9292eb2dde7 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:46.402649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 586/1178] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:46.411510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:46.411950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:46.412090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:46.430549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:46.431853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:46.506502 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 593/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:46.530605 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71bfce-32d0-4d45-8bc2-e9292eb2dde7 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:46.653989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71bfce-32d0-4d45-8bc2-e9292eb2dde7 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:46.689975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:46.690799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:46.691092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:46.691363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:46.703103 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:46.710793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:46.711816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:46.712884 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 587/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:46.718183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:46.730333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:46.820340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33e470-ab1c-4c93-869b-0383c37a6154 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:46.859804 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:46.860473 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:46.860760 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:46.861038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:46.861797 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:46.862106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:46.863528 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:46.871873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 594/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:46.878528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:46.892881 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:46.991406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b95-6a98-4618-a9c8-e37ee4443abc None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:47.029898 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:47.030792 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:47.031127 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:47.031465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] PATH_INFO: `/v3/users/494597787f3543f3a89da45ce253a8a6` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:47.046805 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] RBAC: Authorizing `identity:get_user(user_id=494597787f3543f3a89da45ce253a8a6)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:47.048257 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:47.049912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 588/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:46 2022] GET /identity/v3/users/494597787f3543f3a89da45ce253a8a6 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:47.058785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:47.133087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:47.167179 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fb110-581d-4201-a615-4adc5215ea02 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:47.204420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:47.205071 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:47.205357 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:47.205632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:47.276340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:47.277749 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:47.358609 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:47.395211 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 595/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:47.402493 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:47.472965 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:47.509566 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090972d-79ab-476d-a431-1fa1c88e318c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:47.549336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:47.550136 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:47.550416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:47.550727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] PATH_INFO: `/v3/projects/043679cf30944222af3f1a3e4d93f2d8` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:47.552036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] RBAC: Authorizing `identity:get_project(project_id=043679cf30944222af3f1a3e4d93f2d8)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:47.553484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e2d26-9b59-4abb-83a4-d395c5342897 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:47.555344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 589/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:47 2022] GET /identity/v3/projects/043679cf30944222af3f1a3e4d93f2d8 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:47.562029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:47.674580 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8eee8-92a8-49e6-be12-800693be9f9c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:47.711175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:47.711835 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:47.712120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:47.712398 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:47.713233 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=043679cf30944222af3f1a3e4d93f2d8, user.id=494597787f3543f3a89da45ce253a8a6) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:47.713549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:47.715028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f4892-81dc-43a8-ab46-85db8f9073ac None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:47.720742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 596/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:47 2022] GET /identity/v3/role_assignments?user.id=494597787f3543f3a89da45ce253a8a6&scope.project.id=043679cf30944222af3f1a3e4d93f2d8&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:49.933423 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd26b-f9e1-4c27-b26e-797e01cbe5e5 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:49.934245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd26b-f9e1-4c27-b26e-797e01cbe5e5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:49.934245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd26b-f9e1-4c27-b26e-797e01cbe5e5 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:49.936457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 590/1186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:49.942974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:49.943697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:49.943837 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:49.962008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:49.963277 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:49.994123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:50.038645 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 597/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:50.062338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd26b-f9e1-4c27-b26e-797e01cbe5e5 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:50.179538 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd26b-f9e1-4c27-b26e-797e01cbe5e5 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:50.214301 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:50.215068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:50.215353 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:50.215630 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:50.218344 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:50.227343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:50.234975 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:50.235957 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 19:59:50.236888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 591/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:50.244168 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:50.351361 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8386d3-e63f-4171-a7b5-aec5c13dcf46 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:50.387858 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:50.388523 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:50.388807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:50.389085 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:50.389838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:50.390145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:50.391677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:50.402210 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 598/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:50.411768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:50.528291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba578-9417-4eaa-b755-24a81af568d7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:50.563284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:50.564157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:50.564438 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:50.564713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] PATH_INFO: `/v3/users/494597787f3543f3a89da45ce253a8a6` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:50.565921 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] RBAC: Authorizing `identity:get_user(user_id=494597787f3543f3a89da45ce253a8a6)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:50.567411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:50.569047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 592/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:50 2022] GET /identity/v3/users/494597787f3543f3a89da45ce253a8a6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:50.577108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:50.616556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:50.698414 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa54e-c85c-4a37-819a-247752c6a10d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:50.733639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:50.734508 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:50.734825 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:50.735106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] PATH_INFO: `/v3/projects/043679cf30944222af3f1a3e4d93f2d8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:50.736323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] RBAC: Authorizing `identity:get_project(project_id=043679cf30944222af3f1a3e4d93f2d8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:50.737808 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e18232-983a-4b10-b6fd-7a3bdae541b0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:50.739565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 599/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:50 2022] GET /identity/v3/projects/043679cf30944222af3f1a3e4d93f2d8 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:50.746146 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:50.812924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:50.856840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb41a5f-3c26-4ef6-91c2-4a6fc7355051 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:50.892479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:50.893358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:50.893636 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:50.893904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] PATH_INFO: `/v3/projects/043679cf30944222af3f1a3e4d93f2d8/users/494597787f3543f3a89da45ce253a8a6/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:50.896104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] RBAC: Authorizing `identity:create_grant(project_id=043679cf30944222af3f1a3e4d93f2d8, user_id=494597787f3543f3a89da45ce253a8a6, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:50.897537 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a046934-a6b9-48f0-858e-0166b6b3082c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:50.916779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 593/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 19:59:50 2022] PUT /identity/v3/projects/043679cf30944222af3f1a3e4d93f2d8/users/494597787f3543f3a89da45ce253a8a6/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 19:59:53.095156 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c5f2-d4b5-45b4-9e8d-b932b5a94467 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.095948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c5f2-d4b5-45b4-9e8d-b932b5a94467 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.095948 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2c5f2-d4b5-45b4-9e8d-b932b5a94467 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:53.098176 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 600/1193] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 19:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 19:59:53.104991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.105448 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.105540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:53.133068 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 19:59:53.134246 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 19:59:53.209253 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 594/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 19:59:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 19:59:53.234215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c5f2-d4b5-45b4-9e8d-b932b5a94467 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:53.344465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:53.353731 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2c5f2-d4b5-45b4-9e8d-b932b5a94467 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:53.390863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:53.391665 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.391945 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.392216 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:53.404200 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 19:59:53.411879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 19:59:53.412777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 19:59:53.414024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 601/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 19:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 19:59:53.419472 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:53.489592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:53.553897 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31318869-0ee1-470d-b034-bd872aa0a724 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:53.590985 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:53.591649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.591930 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.592665 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:53.592932 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:53.593494 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:53.594943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:53.604173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 595/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 19:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:53.615264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:53.769256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca971a-7a25-4ffc-989f-b0956eb6d46e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:53.813097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:53.813981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.814272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.814550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] PATH_INFO: `/v3/users/494597787f3543f3a89da45ce253a8a6` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:53.815898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=494597787f3543f3a89da45ce253a8a6)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:53.817381 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:53.819062 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 602/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 19:59:53 2022] GET /identity/v3/users/494597787f3543f3a89da45ce253a8a6 => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:53.828065 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:53.934899 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e36a-de94-4f31-a3d8-2645c9558bd2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:53.951282 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:53.971051 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:53.971704 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:53.971989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:53.972264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:54.042970 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:54.044445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:54.146783 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 596/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 19:59:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 19:59:54.153581 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:54.180633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:54.281042 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828d76e-aa65-4dca-a69d-75253f11e7f9 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:54.318148 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:54.319057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:54.319343 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:54.319651 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] PATH_INFO: `/v3/projects/043679cf30944222af3f1a3e4d93f2d8` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:54.320873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] RBAC: Authorizing `identity:get_project(project_id=043679cf30944222af3f1a3e4d93f2d8)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:54.322354 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571aa2c2-ecfd-498f-8598-230861dd9f5c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:54.324116 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 603/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 19:59:54 2022] GET /identity/v3/projects/043679cf30944222af3f1a3e4d93f2d8 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 19:59:54.330856 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 19:59:54.349724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 19:59:54.435230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e696d17-5a9b-4b29-af08-a3376529a8e7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 19:59:54.471041 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 19:59:54.471695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 19:59:54.471977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 19:59:54.472248 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 19:59:54.473083 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=043679cf30944222af3f1a3e4d93f2d8, user.id=494597787f3543f3a89da45ce253a8a6) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 19:59:54.473396 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 19:59:54.474876 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2b44e-8ba3-48f1-9ef6-8f55ad44763e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 19:59:54.481432 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 597/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 19:59:54 2022] GET /identity/v3/role_assignments?user.id=494597787f3543f3a89da45ce253a8a6&scope.project.id=043679cf30944222af3f1a3e4d93f2d8&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:04.313750 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=54 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:04.478536 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=60 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:52.748799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd61c-63f4-4488-84be-7fcb15e1f9f0 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:52.749385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd61c-63f4-4488-84be-7fcb15e1f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:52.749385 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffd61c-63f4-4488-84be-7fcb15e1f9f0 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:52.751328 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 604/1201] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:00:52.757688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:52.758254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:52.758254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:52.777314 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:00:52.778549 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:00:52.858730 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 598/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:00:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:00:52.880870 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd61c-63f4-4488-84be-7fcb15e1f9f0 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:52.987734 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffd61c-63f4-4488-84be-7fcb15e1f9f0 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:53.023275 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:53.024083 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:53.024370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:53.024649 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:53.036714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:53.038170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:00:53.055924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:53.056807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:53.057677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:00:53.057677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:00:53.057677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:53.057677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:00:53.059051 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 605/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:00:53.063174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:53.168762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1362583-9211-44c6-8f92-56fafdb7274f None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:53.198616 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:53.206013 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:53.206742 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:53.207027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:53.207305 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:53.208036 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:53.208406 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:53.209797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456812-ba30-4f40-b563-23df5f8e4c74 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:53.226559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 599/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:53.227966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:53.284850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:53.339417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1feb2-a857-4c49-b12f-c067da1a9a99 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:53.381258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:53.382054 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:53.382362 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:53.382648 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:53.383479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:53.385006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac787d-0393-4158-aed0-dbebac8229c0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:53.414711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 606/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:00:53 2022] POST /identity/v3/users => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:00:55.811861 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146fed-5779-4c88-8c17-9cee18114568 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:55.812426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146fed-5779-4c88-8c17-9cee18114568 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:55.812426 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae146fed-5779-4c88-8c17-9cee18114568 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:55.813795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 600/1206] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:00:55.819767 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:55.820248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:55.820410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:55.838639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:00:55.839964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:00:55.915441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 607/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:00:55.940056 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146fed-5779-4c88-8c17-9cee18114568 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:56.078033 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae146fed-5779-4c88-8c17-9cee18114568 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:56.119122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:56.120370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:56.120687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:56.121177 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:56.135471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:00:56.144555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:56.145924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:00:56.151626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 601/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:00:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:00:56.154432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:56.198615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:56.275829 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ab957-43a5-408a-beb6-55b32502e72c None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:56.326044 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:56.326919 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:56.327292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:56.327715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:56.328615 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:56.328956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:56.330754 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:56.341417 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 608/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:00:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:56.346963 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:56.410143 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:56.476412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defae1d4-c95d-4535-a194-9a23a13ebc17 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:56.528366 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:56.529230 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:56.529543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:56.529936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:56.544842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:56.546597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:00:56.566057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:56.567207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:56.571685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:00:56.571685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:00:56.571685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:56.571685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:00:56.571685 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 602/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:00:56.573249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:56.686420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:56.690517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45dd99-0fe9-4fbe-8d3f-b2c2828e62bd None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:56.733474 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:56.734279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:56.734623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:56.735017 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:56.735879 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:56.736286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:56.737823 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:56.750526 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 609/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:56.756368 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:56.868247 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ad9a1-6b42-414e-bead-7c9a27eb1e1a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:56.869851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:56.904867 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:56.905691 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:56.905977 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:56.906255 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:56.916291 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:56.917785 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:00:56.934016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:56.935117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:00:56.935982 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 603/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:00:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:00:56.941072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:57.057662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cda92-b036-4937-8ae3-abf72341b157 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:57.103368 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:57.104049 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:57.104331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:57.104605 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:57.105457 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:57.105788 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:57.107792 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:57.130159 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 610/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:00:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:57.136114 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:57.257237 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184b983-c799-4747-9d4f-0484f27d8943 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:57.298740 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:57.299545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:57.299833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:57.300111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:57.336559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:57.382886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:57.384451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:57.498070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 604/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:00:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:00:57.503928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:57.533335 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:57.624791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02c60-d8b5-4e86-ace5-ec426cf09338 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:57.665953 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:57.667245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:57.667646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:57.667859 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:57.679369 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:57.680988 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:00:57.699476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:57.700780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:57.701612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:00:57.701612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:00:57.701612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:00:57.701612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:00:57.701612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 611/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:00:57.706864 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:57.777434 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:57.821846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb215d-3ebf-4bac-906a-50f377b5c2ef None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:57.870989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:57.871680 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:57.871955 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:57.872226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:57.873042 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:57.873399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:57.875149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:57.897710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 605/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:57.904016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:57.987701 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:58.021146 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6d60-7e9d-4f81-8bf7-ea53b5903e77 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:58.065944 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:58.066815 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:58.067099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:58.067429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:58.075276 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:58.076958 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:00:58.092140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:00:58.093019 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:00:58.093950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 612/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:00:58.100099 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:58.229003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6392-ef9a-4d39-9272-e4fc56027658 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:58.258465 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:58.273182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:58.273866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:58.274157 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:58.274435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:58.275273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:58.275590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:58.277424 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470d827-4301-4e8f-940c-ae11b0088a7e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:58.292139 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 606/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:00:58.299384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:00:58.422493 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1bf0-ad38-4b22-bdb0-11284e92f049 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:00:58.453041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:00:58.461346 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:00:58.462084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:00:58.462376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:00:58.462676 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:00:58.463614 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=826f55d74e104105897ed344a1b02765) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:00:58.463950 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:00:58.465503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e676a87-3f23-4c85-ba4d-4ed5c0ebf63b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:00:58.472331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 613/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:00:58 2022] GET /identity/v3/role_assignments?user.id=826f55d74e104105897ed344a1b02765&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:00.820343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c67a-ffad-42aa-96f8-6cf7bcc8d7ec None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:00.820916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c67a-ffad-42aa-96f8-6cf7bcc8d7ec None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:00.820916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1c67a-ffad-42aa-96f8-6cf7bcc8d7ec None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:00.822739 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 607/1220] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:00.828949 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:00.829463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:00.829562 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:00.853795 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:00.855144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:00.938768 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 614/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:00.962153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1c67a-ffad-42aa-96f8-6cf7bcc8d7ec None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.077515 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1c67a-ffad-42aa-96f8-6cf7bcc8d7ec None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:01.114528 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:01.115373 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:01.115658 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:01.115948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:01.127524 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:01:01.136168 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:01.137288 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:01.138254 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 608/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:01:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:01.143955 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.257686 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d283a-4f67-40b0-8891-716a0cfcb03e None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:01.284506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:01.296863 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:01.297555 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:01.297842 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:01.298124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:01.298902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] RBAC: Adding query filter params (name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:01.299214 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:01.300595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:01.309185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 615/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:01:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:01.315644 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.375637 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:01.438012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231978f-3aa3-4e49-826e-15dbc3d4f4f4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:01.472412 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:01.473224 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:01.473557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:01.473857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:01.485624 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:01.487281 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:01.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:01.507059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:01.513543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:01.513543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:01.513543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:01.513543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:01.513543 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 609/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:01.513969 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.622318 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfd342-ad2a-4e22-b254-6490defe1b26 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:01.662517 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:01.663215 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:01.663497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:01.663773 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:01.664496 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:01.664803 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:01.666172 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:01.677935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 616/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:01.684452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.787000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:01.794672 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed7477-52c6-4211-84a9-8cc44478fa6e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:01.829878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:01.830828 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:01.831091 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:01.831358 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:01.840512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:01.842318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:01:01.859003 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:01.859971 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:01.860981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 610/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:01.866888 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:01.926050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:01.984319 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8502e9b-e1ad-4dbd-a789-01ecba456801 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.019607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.020308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.020632 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.020968 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.021955 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:02.022278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.024794 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.045702 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 617/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:01:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:02.051803 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:02.172169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5af17c-e73d-451a-8749-5e5be5777565 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.209557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.210410 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.211446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.211446 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.222858 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.224459 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:02.243517 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:02.244609 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:02.245473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:02.245473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:02.245473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:02.245473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:02.245473 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 611/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:02.251063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:02.360022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dd03c-8417-4cca-864a-70fefb6bfe78 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.362960 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:02.399935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.400613 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.400894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.401171 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.401898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:02.402203 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.403693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.416593 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 618/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:02.422634 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:02.433525 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:02.535614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a903c-3219-484c-9c9d-596de2439f03 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.569652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.570461 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.570791 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.571081 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.578165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.579787 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:01:02.594510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:02.595510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:02.596308 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 612/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:02.602333 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:02.708594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8648-498f-40e7-b19e-d89e7f9965c5 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.743666 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.744342 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.744627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.744956 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.745694 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:02.746008 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.747518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20569758-d02a-46ec-b448-7be3b0bb220f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.761082 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 619/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:02.767482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:02.841364 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:02.876964 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad7a73-38c7-48d1-8437-e0d0f712df5d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:02.911339 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:02.912197 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] REQUEST_METHOD: `PUT` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:02.912480 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:02.912753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/826f55d74e104105897ed344a1b02765/roles/f5a864d3dbe24141b1dc88a02d67775a` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:02.927451 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=826f55d74e104105897ed344a1b02765, role_id=f5a864d3dbe24141b1dc88a02d67775a)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:02.928919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c400f1-9bc8-4a56-bf93-a2a2b199f008 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:02.941757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 613/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:01:02 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/826f55d74e104105897ed344a1b02765/roles/f5a864d3dbe24141b1dc88a02d67775a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:01:05.208465 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a064-9fb6-42df-98ec-9dd584b3db52 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:05.209084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a064-9fb6-42df-98ec-9dd584b3db52 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:05.209084 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a064-9fb6-42df-98ec-9dd584b3db52 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:05.210533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 620/1233] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:05.215981 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:05.216452 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:05.216572 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:05.234198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:05.235614 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:05.305381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 614/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:05.329691 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4a064-9fb6-42df-98ec-9dd584b3db52 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:05.358845 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:05.440068 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4a064-9fb6-42df-98ec-9dd584b3db52 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:05.477121 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:05.477862 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:05.478199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:05.478476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:05.489867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:01:05.498419 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:05.499572 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:05.500351 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 621/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:01:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:05.506020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:05.555789 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:05.615826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779c7e-3447-49c2-8bf7-dfefa130daff None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:05.654653 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:05.655776 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:05.656267 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:05.657132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:05.658598 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:05.659239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:05.661795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:05.672806 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 615/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:01:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:05.679050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:05.776506 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:05.794724 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3363-b565-4a2f-a879-4610d8a5a793 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:05.831043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:05.831856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:05.832144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:05.832427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:05.844556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:05.846076 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:05.864166 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:05.865041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:05.865854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:05.865854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:05.865854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:05.865854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:05.865854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 622/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:05.871481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:05.992747 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71945-ae8e-4d9a-82a4-1bc5546d9a2c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:06.003055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:06.033338 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:06.033943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:06.034273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:06.034606 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:06.035498 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:06.035840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:06.039029 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:06.052289 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 616/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:06.059721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:06.181249 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088c3d-03a0-4fa2-bb1c-cfc222ebee2c None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:06.216694 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:06.217545 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:06.217856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:06.218137 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] PATH_INFO: `/v3/users/placement` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:06.221120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:06.227633 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:06.229396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:01:06.246162 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:06.247279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:06.248310 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 623/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:06.253514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:06.367532 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11521-589e-4128-8dfc-d65d6576f53d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:06.405011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:06.405701 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:06.405986 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:06.406264 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:06.407152 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:06.407467 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:06.408920 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:06.428133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 617/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:01:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:06.434416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:06.552370 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f2c93-e82e-4771-85ab-540678cb264e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:06.592145 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:06.592961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:06.593250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:06.593530 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:06.661898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:06.669404 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:06.671312 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:06.778607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 624/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:01:06.784603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:06.813408 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:06.899799 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbed053-0179-40e4-800d-1039c573df59 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:06.940796 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:06.941611 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:06.941900 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:06.942202 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:06.953403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:06.955134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:06.973399 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:06.974954 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:06.975840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:06.975840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:06.975840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:06.975840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:06.975840 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 618/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:06.981063 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:07.085072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:07.091501 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5c04-9671-47e0-bfcf-bb4851de590d None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:07.130459 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:07.131269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:07.131504 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:07.131774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:07.132544 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:07.132891 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:07.134256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:07.145936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 625/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:07.153632 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:07.240442 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:07.265239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecbb0-ec77-4e33-b8fb-9b90ac20471c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:07.302602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:07.303444 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:07.303729 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:07.304006 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:07.311716 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:07.313500 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:01:07.331365 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:07.332354 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:07.333375 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:07.335156 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 619/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:01:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:07.341949 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:07.461183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36604fee-037c-4f66-8b05-81213efda55e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:07.499278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:07.500240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:07.500524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:07.500814 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:07.501595 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:07.501910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:07.503415 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4be2e-157f-4ac2-b50e-810e7c4965b9 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:07.516548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 626/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:01:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:07.523147 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:07.637283 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c801b7-09ce-45ba-9c45-891b145b2e54 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:07.671928 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:07.672627 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:07.672911 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:07.673184 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:07.674015 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] RBAC: Adding query filter params (role.id=f5a864d3dbe24141b1dc88a02d67775a, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=826f55d74e104105897ed344a1b02765) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:07.674325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:07.675851 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642afb94-58c8-4e38-b1e2-948a17b6c3b7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:07.682002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 620/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:01:07 2022] GET /identity/v3/role_assignments?user.id=826f55d74e104105897ed344a1b02765&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=f5a864d3dbe24141b1dc88a02d67775a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:10.274611 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9393-32c6-4cbd-bf5a-fd04cf7e6817 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:10.275169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9393-32c6-4cbd-bf5a-fd04cf7e6817 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:10.275278 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9393-32c6-4cbd-bf5a-fd04cf7e6817 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:10.276589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 627/1247] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:10.283381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:10.283866 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:10.283959 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:10.289988 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:10.303282 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:10.304629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:10.387333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 621/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:10.412427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9393-32c6-4cbd-bf5a-fd04cf7e6817 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:10.431141 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:10.528056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9393-32c6-4cbd-bf5a-fd04cf7e6817 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:10.567309 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:10.568122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:10.568410 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:10.568692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:10.579669 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:01:10.588002 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:10.588963 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:10.589806 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 628/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:10.595737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:10.711047 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a86b9-6795-4cb6-9776-b0099912a393 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:10.747509 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:10.754239 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:10.755104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:10.755479 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:10.755836 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:10.756757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:10.757371 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:10.759000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:10.769544 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 622/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:10.777254 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:10.864681 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:10.890970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7d8ee-9529-4422-9fcc-265d24075802 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:10.930630 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:10.931546 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:10.931871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:10.932185 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:10.945180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:10.947057 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:10.965536 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:10.967604 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:10.968682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:10.968682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:10.968682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:10.968682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:10.968682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 629/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:01:10.973012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:11.084481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50338386-5982-4683-aa80-5f61718bdc8a None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:11.123045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:11.123679 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:11.124001 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:11.124394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:11.125173 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:11.125483 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:11.127071 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:11.141565 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 623/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:11.147453 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:11.255120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b19e3e-5810-49bb-980d-c3d02d471a19 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:11.286636 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:11.295876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:11.296735 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:11.297018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:11.297300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:11.305890 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:11.307538 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:01:11.324180 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:11.325450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:11.326799 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 630/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:11.331860 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:11.401087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:11.450882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d831f-2ba1-4ffb-b70c-dba5a2a8e8aa None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:11.487991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:11.488657 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:11.488991 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:11.489271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:11.490122 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:11.490435 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:11.491924 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:11.511234 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 624/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:01:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:11.517421 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:11.634269 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356adb42-e645-46a4-9019-40bab800b9fe None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:11.675340 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:11.676178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:11.676494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:11.676792 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:11.742670 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:11.756836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:11.758327 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:11.868976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 631/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:01:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:01:11.875362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:11.991153 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfaac7-5f1b-489a-b94b-7c82abce9388 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:12.007625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:12.032149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:12.033038 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:12.033327 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:12.034079 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:12.051877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:12.053641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:12.074318 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:12.075404 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:12.081608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:12.081608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:12.081608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:12.081608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:12.081608 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 625/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:12.083820 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:12.193442 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:12.208867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29cb3-e39a-4974-bc5f-74269194d3db None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:12.252917 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:12.253524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:12.253887 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:12.254201 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:12.255514 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:12.255931 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:12.257646 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:12.270316 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 632/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:12.276951 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:12.413078 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33ba0-09f4-435c-967d-2b63281696b4 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:12.456697 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:12.457548 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:12.457842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:12.458121 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:12.466416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:12.468070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:01:12.484674 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:12.486084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:12.488124 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 626/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:12.492139 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:12.603683 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f7ebf-25ed-46ea-b990-24dbdc4907d0 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:12.644719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:12.645425 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:12.645714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:12.646005 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] PATH_INFO: `/v3/projects` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:12.646834 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:12.647143 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:12.648608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb096-95e7-4353-892d-a110a153af38 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:12.661339 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 633/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:12.667597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:12.695198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:12.788016 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b103e7-102f-409f-9910-ce05380b21b7 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:12.830092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:12.830896 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:12.831218 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:12.831599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:12.832844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=826f55d74e104105897ed344a1b02765) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:12.833199 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:12.834844 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c71be-57a7-4c8a-8043-4dbe39b92959 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:12.841641 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 627/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:01:12 2022] GET /identity/v3/role_assignments?user.id=826f55d74e104105897ed344a1b02765&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:15.135935 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183f3e-e7bc-4789-9328-b64d3e1996ba None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:15.136793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183f3e-e7bc-4789-9328-b64d3e1996ba None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:15.136793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183f3e-e7bc-4789-9328-b64d3e1996ba None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:15.139094 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 634/1261] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:15.145324 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:15.145757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:15.145886 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:15.164786 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:15.166027 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:15.257904 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 628/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:15.281503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13183f3e-e7bc-4789-9328-b64d3e1996ba None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:15.295322 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:15.409552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13183f3e-e7bc-4789-9328-b64d3e1996ba None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:15.446178 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:15.447004 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:15.447285 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:15.447552 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:15.459672 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:01:15.467242 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:15.468264 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:15.469122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 635/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:15.477046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:15.505940 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:15.592695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b7ddd-9df2-44d8-b534-1b83a4bfb048 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:15.629384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] PATH_INFO: `/v3/roles` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:15.638307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:15.643534 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 629/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:15.650297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:15.736284 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:15.771932 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf64e7-336c-40ac-a145-7ca18ba3bcea None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:15.806836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:15.807627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:15.807912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:15.808190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:15.819352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:15.820826 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:15.837974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:15.838983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:15.839882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:15.839882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:15.839882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:15.839882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:15.839882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 636/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:15.845156 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:15.935599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:15.964855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15450bd1-77aa-4a8b-ac1f-73ecfafea613 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.005057 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.005649 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.005936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.006211 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.006966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:16.007277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.008683 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.021877 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 630/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:16.028124 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.134867 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7623-5f9b-4fe6-8fed-fd06cb9b0667 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.156796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:16.173182 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.173989 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.174273 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.174548 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.182503 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.184000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:01:16.198652 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:16.199711 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:16.200693 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 637/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:16.206093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.320620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ca72a-912d-4b70-a5d9-2b9af138788d None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.362802 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.363483 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.363766 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.364037 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] PATH_INFO: `/v3/users` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.364880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:16.365190 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.366974 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.377555 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:16.388824 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 631/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:16.395682 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.506155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4a9ac-c1ca-4ba6-b1cf-35bdd3123998 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.541997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.542821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.543106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.543384 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.554096 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.555608 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:16.573147 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:16.574097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:16.574981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:16.574981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:16.574981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:16.574981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:16.574981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 638/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:16.581007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.688418 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7c7a-aa26-4a72-97f9-c94f427f2f5e None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.726547 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.727688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.728162 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.728635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.729830 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:16.730356 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.732599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.746652 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 632/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:16.754980 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.788873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:16.862671 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285d9b-9e11-43b4-9b9b-f4a8659f2685 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:16.897454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:16.898240 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:16.898521 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:16.898827 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:16.905987 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:16.907471 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:01:16.921936 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:16.922937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:16.923966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 639/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:16.929700 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:16.993788 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:17.039947 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d0f52-0a44-4b78-a4a9-d0f924be57fa None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:17.075102 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:17.075758 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:17.076045 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:17.076323 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:17.077109 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:17.077422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:17.078907 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33357550-61b9-4649-b3f2-88c7179154f6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:17.091165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 633/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:17.097420 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:17.195120 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:17.209895 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520adf-a842-4c21-af04-e65fa4ea1dea None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:17.246841 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:17.247725 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] REQUEST_METHOD: `PUT` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:17.248006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:17.248279 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] PATH_INFO: `/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/826f55d74e104105897ed344a1b02765/roles/547f3c519e8041caa36ad34c2c4df9c9` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:17.250360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] RBAC: Authorizing `identity:create_grant(project_id=356c82a6bb6148efb1465c9804bd681e, user_id=826f55d74e104105897ed344a1b02765, role_id=547f3c519e8041caa36ad34c2c4df9c9)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:17.251846 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65765f36-4886-4b3b-ae08-ce13f353556b None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:17.266337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 640/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:01:17 2022] PUT /identity/v3/projects/356c82a6bb6148efb1465c9804bd681e/users/826f55d74e104105897ed344a1b02765/roles/547f3c519e8041caa36ad34c2c4df9c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:01:19.462761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e985b-43ac-4665-b087-c89df9c87845 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:19.463343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e985b-43ac-4665-b087-c89df9c87845 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:19.463343 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e985b-43ac-4665-b087-c89df9c87845 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:19.464740 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 634/1274] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:01:19.470959 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:19.471695 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:19.471868 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:19.500855 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:19.502038 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:19.573807 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 641/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:19.601688 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e985b-43ac-4665-b087-c89df9c87845 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:19.717635 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e985b-43ac-4665-b087-c89df9c87845 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:19.735540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:19.754916 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:19.755724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:19.756012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:19.756284 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:19.766927 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:01:19.774723 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:19.775719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:01:19.776673 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:19.778857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 635/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:19.782678 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:19.873175 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:19.894336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9e28-2fc0-4e7e-be75-f851269f175f None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:19.932395 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:19.933056 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:19.933335 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:19.933607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] PATH_INFO: `/v3/roles` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:19.934352 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:19.934657 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:19.936064 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:19.944851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 642/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:19.950996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:20.059926 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5319fd-760d-4b28-bc40-9a13c8d809cf None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:20.109273 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:20.110076 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:20.110363 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:20.110645 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:20.121872 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:20.123422 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:20.140941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:20.141883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:20.143101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:20.143101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:20.143101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:20.143101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:20.143101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 636/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:20.150353 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:20.273698 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674f519-7856-4dfe-81f6-3d048219b271 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:20.309396 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:20.310126 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:20.310323 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:20.310627 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] PATH_INFO: `/v3/domains` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:20.311391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:20.311704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:20.313090 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:20.332885 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 643/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:20.334502 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:20.367845 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:20.439572 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3948bdf-948a-4611-bc9c-4778992a8b60 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:20.479625 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:20.480445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:20.480732 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:20.481011 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:20.488778 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:20.490242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:01:20.504620 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:20.506443 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:20.508698 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 637/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:20.514292 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:20.518876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:20.652667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c93823-82ce-441a-9388-545d0f304109 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:20.693158 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:20.693828 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:20.694110 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:20.694387 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] PATH_INFO: `/v3/users` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:20.695259 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:20.695571 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:20.697018 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:20.713974 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 644/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:01:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:20.720133 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:20.817834 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:20.828170 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf7b41-f8ac-4540-9aa7-db8d1eee46a9 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:20.864111 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:20.864757 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:20.865034 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:20.865307 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:20.935393 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:20.936797 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.028403 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:21.044675 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 638/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:01:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:01:21.051331 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:21.115851 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:21.158039 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e006ab-ef8c-4fbd-bfcc-98f1c4afb81e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:21.193786 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:21.194519 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:21.194835 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:21.195102 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:21.205843 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:21.207391 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:01:21.225876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:21.226872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:21.227739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:01:21.227739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:01:21.227739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:01:21.227739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:21.227739 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 645/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:21.233471 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:21.339504 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98ade-ab45-404d-bb8b-e43ef1cdeafb None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:21.375020 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:21.375696 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:21.375984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:21.376285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:21.377005 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:21.377319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:21.378737 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.391226 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 639/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:21.400360 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:21.513722 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2efed-0324-42b4-921a-7e3340a4ed8e None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:21.527697 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:21.549655 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:21.550454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:21.550758 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:21.551062 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:21.559028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:21.561755 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:01:21.576229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application with Lock( May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:21.577198 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:01:21.578155 dv-cinder-835881-13-smb devstack@keystone.service[144063]: ERROR keystone.server.flask.application May 19 20:01:21.582295 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 646/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:21.583482 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:21.638478 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:21.690941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a9926-f326-4edc-9bec-7983ce58e4c2 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:21.729383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:21.730046 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:21.730415 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:21.730800 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] PATH_INFO: `/v3/projects` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:21.731602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:21.731914 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:21.733360 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7133-973a-4787-8c7d-0eabb12a9589 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.745841 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 640/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:21.755868 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:21.865383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5f26-a094-4ae6-9242-cd3c96150112 None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:21.900721 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:21.901373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:21.901650 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:21.901928 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:21.902793 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] RBAC: Adding query filter params (role.id=547f3c519e8041caa36ad34c2c4df9c9, scope.project.id=356c82a6bb6148efb1465c9804bd681e, user.id=826f55d74e104105897ed344a1b02765) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:21.903104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:21.904549 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21701e43-3ff3-4b90-ae12-ba84a0dea85d None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:21.910578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 647/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:01:21 2022] GET /identity/v3/role_assignments?user.id=826f55d74e104105897ed344a1b02765&scope.project.id=356c82a6bb6148efb1465c9804bd681e&role.id=547f3c519e8041caa36ad34c2c4df9c9 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:24.121583 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b97f-c22c-4b08-a4fe-89c289fa2aa4 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:24.122437 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b97f-c22c-4b08-a4fe-89c289fa2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:24.122437 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b97f-c22c-4b08-a4fe-89c289fa2aa4 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:24.124854 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 641/1288] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:24.131194 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:24.131964 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:24.132140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:24.154728 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:24.155970 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:24.186677 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:24.230439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 648/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:24.256394 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b97f-c22c-4b08-a4fe-89c289fa2aa4 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:24.373910 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b97f-c22c-4b08-a4fe-89c289fa2aa4 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:24.385026 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:24.412499 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:24.413312 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:24.413597 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:24.413878 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] PATH_INFO: `/v3/services/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:24.414535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:24.415994 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:24.428342 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:24.429481 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:24.430322 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 642/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:01:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:24.435849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:24.553267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb484527-cf8e-4664-afd4-cd15dcb871b1 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:24.590605 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:24.591308 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:24.591594 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:24.591873 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:24.592587 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] RBAC: Adding query filter params (name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:24.592894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:24.594281 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23ab5a-6cfc-40db-9fda-94404e306a43 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:24.599800 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 649/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:01:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:01:24.605816 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:24.713855 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15b70-4555-4b18-ad66-50adc8b2f942 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:24.752261 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:24.752922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:24.753207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:24.753486 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] PATH_INFO: `/v3/services` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:24.754204 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] RBAC: Adding query filter params (type=placement) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:24.754514 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:24.755976 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec08e5-8dda-46b6-b831-2f673c981c82 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:24.760826 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 643/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:01:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:26.933913 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c860-042d-48f0-93d4-0f7ac86c93d4 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:26.934798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c860-042d-48f0-93d4-0f7ac86c93d4 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:26.934798 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c860-042d-48f0-93d4-0f7ac86c93d4 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:26.936912 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 650/1293] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:26.943527 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db5c-05d8-4498-aa67-2b3feb5d8696 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:26.944210 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db5c-05d8-4498-aa67-2b3feb5d8696 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:26.944429 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8db5c-05d8-4498-aa67-2b3feb5d8696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:26.973062 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-1ae8db5c-05d8-4498-aa67-2b3feb5d8696 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:26.975232 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-1ae8db5c-05d8-4498-aa67-2b3feb5d8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:27.011758 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:27.058958 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 644/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:27.082324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c860-042d-48f0-93d4-0f7ac86c93d4 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:27.126282 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:27.202673 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c860-042d-48f0-93d4-0f7ac86c93d4 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:27.239294 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:27.239966 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:27.240234 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:27.240538 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:27.241272 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:27.242667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be59ca-ceee-4312-8d33-0e8ed27a90b7 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:27.258718 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 651/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:01:27 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:01:29.465713 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01b4f-f48f-4bd7-8e8f-69130855caba None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:29.466601 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01b4f-f48f-4bd7-8e8f-69130855caba None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:29.466601 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c01b4f-f48f-4bd7-8e8f-69130855caba None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:29.468847 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 645/1296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:29.478301 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:29.478752 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:29.478955 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:29.500183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:29.501390 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:29.580854 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 652/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:29.603882 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c01b4f-f48f-4bd7-8e8f-69130855caba None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:29.712510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c01b4f-f48f-4bd7-8e8f-69130855caba None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:29.750104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:29.751300 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:29.751749 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:29.752169 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] PATH_INFO: `/v3/services/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:29.753244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:29.755007 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:29.768329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:29.769495 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:29.770760 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 646/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:01:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:29.779099 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:29.798286 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:29.887629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec3832-8277-462c-8bc5-d5549c930295 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:29.933508 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:29.934169 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:29.934450 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:29.934716 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:29.935445 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] RBAC: Adding query filter params (name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:29.935748 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:29.937133 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:29.942894 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 653/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:01:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:29.952262 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:29.989271 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:30.083592 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dee3-3245-4849-8fc2-5feea8075f2c None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:30.123274 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:30.123936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:30.124238 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:30.124540 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:30.125332 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] RBAC: Adding query filter params (interface=public, service_id=8a0699b333de45aea883410b26005188, region_id=RegionOne) {{(pid=144062) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:30.125647 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:30.127055 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c4641-5521-4875-8337-703f2d2db302 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:30.132325 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 647/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:01:29 2022] GET /identity/v3/endpoints?service_id=8a0699b333de45aea883410b26005188&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:30.138914 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:30.236454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:30.270041 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a09db8-8e4f-41bc-939e-a08d7984415f None admin] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:30.306621 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:30.307330 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:30.307623 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:30.307904 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:30.308592 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:30.309983 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae28c-0517-402e-bc8c-db58383f6f4c None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:30.316864 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 654/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:01:30 2022] GET /identity/v3/services => generated 2191 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:01:32.523973 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acd78-2104-4d7f-98bb-f7cc41661aa2 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:32.524857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acd78-2104-4d7f-98bb-f7cc41661aa2 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:32.524857 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acd78-2104-4d7f-98bb-f7cc41661aa2 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:32.527135 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 648/1302] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:01:32.535984 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:32.536411 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:32.536586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:32.560429 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:01:32.561629 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:01:32.634985 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 655/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:01:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:01:32.658182 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82acd78-2104-4d7f-98bb-f7cc41661aa2 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:32.763629 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:32.771590 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82acd78-2104-4d7f-98bb-f7cc41661aa2 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:32.806427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:32.807185 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:32.807466 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:32.807744 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:32.808392 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:32.809779 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:01:32.822012 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:01:32.823113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application with Lock( May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self._enter() May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application return self.creator() May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application created_value = creator( May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: ERROR keystone.server.flask.application May 19 20:01:32.824000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 649/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:01:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:01:32.830089 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:32.916427 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:32.940856 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51841c18-00c0-477b-9e8f-5c1f8cd5aca2 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:32.978813 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:32.979477 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:32.979756 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:32.980030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] PATH_INFO: `/v3/services` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:32.980730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=144063) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:01:32.981035 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:32.982389 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9aa448-e639-48b2-ad21-d3cfd92e64f1 None admin] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:32.988439 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 656/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:01:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:01:32.997764 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:01:33.116989 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf54a-55f0-411e-bfc9-d86379e7a1d6 None admin] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:01:33.151427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296d7ae67cfb462aa7db38b0f4a6b740', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:01:33.152077 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:01:33.152362 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:01:33.152639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:01:33.153383 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:01:33.154795 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a81af0-7a2d-406d-bfbf-ac8e4ee4af8d None admin] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:01:33.176571 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 650/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:01:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:01:42.984788 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=30 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:01:43.171919 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.344214 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bae3b-d5dd-4eb9-b734-236c3fa8c3f3 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.344796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bae3b-d5dd-4eb9-b734-236c3fa8c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.344796 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bae3b-d5dd-4eb9-b734-236c3fa8c3f3 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.347106 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 657/1307] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:38.353457 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba411-ae5d-4041-851e-facf8fcc6311 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.354600 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba411-ae5d-4041-851e-facf8fcc6311 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.355118 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bba411-ae5d-4041-851e-facf8fcc6311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.506430 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-56bba411-ae5d-4041-851e-facf8fcc6311 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:38.507607 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-56bba411-ae5d-4041-851e-facf8fcc6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:38.624128 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 651/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:38.687392 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.687578 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.687872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.689850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 658/1309] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:38.711668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ccdf2-efae-4b1d-a3bd-981003fb9e62 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:38.712010 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ccdf2-efae-4b1d-a3bd-981003fb9e62 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:38.712228 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ccdf2-efae-4b1d-a3bd-981003fb9e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:38.792067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-328ccdf2-efae-4b1d-a3bd-981003fb9e62 None None] MFA Rules not processed for user `de95d4bce1b742318f16a6be59eada28`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:38.793433 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-328ccdf2-efae-4b1d-a3bd-981003fb9e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:38.814548 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:38.915070 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 652/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:02:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:38.915730 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:38.917625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:39.089108 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ca42-9c62-4722-800c-9dc8a38e1b0b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:39.185901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:39.186997 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:39.187696 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:39.188212 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:39.190224 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:39.252780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:39.318556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:39.320475 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9d723-0bca-446d-8fc3-0d8986ad1dfb service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:39.344379 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 659/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:02:41.880243 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b535-622c-4484-a011-0a1500c33ac0 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:41.881233 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b535-622c-4484-a011-0a1500c33ac0 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:41.881717 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0b535-622c-4484-a011-0a1500c33ac0 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:41.883386 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 653/1312] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:41.889229 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c4d9-6713-4279-a94f-2b78f9bfad2d None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:41.889683 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c4d9-6713-4279-a94f-2b78f9bfad2d None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:41.889771 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c4d9-6713-4279-a94f-2b78f9bfad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:41.968444 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-1a07c4d9-6713-4279-a94f-2b78f9bfad2d None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:41.969556 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-1a07c4d9-6713-4279-a94f-2b78f9bfad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:42.074443 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 660/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:42.125984 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:42.126372 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:42.126542 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:42.128277 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 654/1314] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:42.134774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e6b9-6a34-4118-b39a-b7e379d4bf32 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:42.135228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e6b9-6a34-4118-b39a-b7e379d4bf32 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:42.135667 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e6b9-6a34-4118-b39a-b7e379d4bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:42.147382 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:42.221759 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-f8d6e6b9-6a34-4118-b39a-b7e379d4bf32 None None] MFA Rules not processed for user `de95d4bce1b742318f16a6be59eada28`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:42.223033 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-f8d6e6b9-6a34-4118-b39a-b7e379d4bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:42.316533 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 661/1315] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:42.326067 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:42.327880 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:42.447842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff3717-3980-4b79-92e3-acf76baea54e None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:42.528270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:42.530980 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:42.532556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:42.532556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:42.532556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:42.534186 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:42.654640 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:42.656132 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bebfd-ed79-47f4-a437-b8423c9e44b6 service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:42.679755 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 655/1316] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:02:45.479128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.479727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.479727 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.481087 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 662/1317] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:45.487008 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df089a2-7992-4c70-a48f-6ddb246d75d6 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.487464 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df089a2-7992-4c70-a48f-6ddb246d75d6 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.487554 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df089a2-7992-4c70-a48f-6ddb246d75d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.556030 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-3df089a2-7992-4c70-a48f-6ddb246d75d6 None None] MFA Rules not processed for user `31cd1e327fa840af953d5511aa070317`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:45.557336 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-3df089a2-7992-4c70-a48f-6ddb246d75d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:45.610732 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.657117 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 656/1318] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:45.697297 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:45.698906 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:45.807262 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa8c69-8073-4c5f-a0fa-fe2e7f8180fd None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:45.811607 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:45.905128 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:45.905850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:45.906144 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:45.906416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:45.908204 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:46.030573 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:46.032134 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6b43-6472-4751-a32f-062f9ed7e020 service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:46.051738 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 663/1319] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:02:48.815556 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.816398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.816398 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.818557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 657/1320] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:48.825006 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca685c6-f697-4931-a036-1aaae82af082 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:48.825713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca685c6-f697-4931-a036-1aaae82af082 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:48.825898 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca685c6-f697-4931-a036-1aaae82af082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:48.870247 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:48.898183 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-0ca685c6-f697-4931-a036-1aaae82af082 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:48.899454 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-0ca685c6-f697-4931-a036-1aaae82af082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:49.004012 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 664/1321] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:49.058584 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:49.060150 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:49.172134 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8823e-2fe3-423f-b35d-be21b8e37aaf None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:49.250848 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:49.251535 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:49.251815 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:49.252093 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:49.253727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:49.261221 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:49.377411 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:49.378895 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd0a4-a0ea-4443-8b5b-c1120c726c67 service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:49.398639 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 658/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:02:52.285245 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.285836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.285836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.287499 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 665/1323] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:52.293395 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373d49-d760-417f-b636-8967397399a2 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.293810 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373d49-d760-417f-b636-8967397399a2 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.294018 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a373d49-d760-417f-b636-8967397399a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.363990 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-4a373d49-d760-417f-b636-8967397399a2 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:52.365217 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-4a373d49-d760-417f-b636-8967397399a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:52.424126 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.466106 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 659/1324] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:52.501976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:52.503628 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:52.619622 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d4ab-b7b1-4547-8549-360b8d452267 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:52.634050 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:52.698853 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:52.699510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:52.699794 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:52.700069 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:52.701714 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:52.818046 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:52.819525 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf41a0-5859-4cdb-ba21-a95eeb72f164 service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:52.843882 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 666/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:02:55.126520 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.127103 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.127103 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.128724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 660/1326] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:55.134497 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd60f-1113-45b5-a9a9-7aaf9ca957e4 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.134937 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd60f-1113-45b5-a9a9-7aaf9ca957e4 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.135104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dd60f-1113-45b5-a9a9-7aaf9ca957e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.186016 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.204830 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-353dd60f-1113-45b5-a9a9-7aaf9ca957e4 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:55.206032 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-353dd60f-1113-45b5-a9a9-7aaf9ca957e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:55.305247 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 667/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:55.342113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:55.343762 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:55.453384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65185df-9a62-47bc-bcbf-a7e420ba727c None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:55.531098 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:55.532053 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:55.532347 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:55.532626 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:55.534280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:55.551842 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:55.647285 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:55.648743 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2988155-b613-4c64-bb8a-c6bc49771feb service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:55.667948 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 661/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:02:57.922480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.923190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.923190 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:57.924585 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 668/1329] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:02:57.930114 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82e91-22b5-4304-ab52-9bf0916c7f8e None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:57.930557 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82e91-22b5-4304-ab52-9bf0916c7f8e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:57.930651 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82e91-22b5-4304-ab52-9bf0916c7f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.003165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-0af82e91-22b5-4304-ab52-9bf0916c7f8e None None] MFA Rules not processed for user `31cd1e327fa840af953d5511aa070317`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:02:58.004416 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-0af82e91-22b5-4304-ab52-9bf0916c7f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:58.074710 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.107768 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 662/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:02:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:02:58.145220 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:02:58.146849 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:58.254409 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0046b-bbcd-436c-883f-3a4636f8ed4b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:02:58.275774 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:02:58.330376 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:02:58.331060 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:02:58.331338 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:02:58.331612 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:02:58.333258 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:02:58.454625 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:02:58.456150 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0724-8d43-49af-acac-0bbef011f4a7 service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:02:58.476717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 669/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:02:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:01.117326 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.118174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.118174 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.120573 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 663/1332] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:01.128717 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff14d9-abf9-43d5-afc4-0f38513f71cb None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.129138 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff14d9-abf9-43d5-afc4-0f38513f71cb None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.129256 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff14d9-abf9-43d5-afc4-0f38513f71cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.202029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.205704 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-3cff14d9-abf9-43d5-afc4-0f38513f71cb None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:01.207836 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-3cff14d9-abf9-43d5-afc4-0f38513f71cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:01.319479 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 670/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:01.356582 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:01.358315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:01.464333 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9ac2-cd60-4cb6-b0e4-642fffa77b60 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:01.539846 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:01.540518 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:01.540807 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:01.541084 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:01.542769 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:01.571302 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:01.663848 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:01.665329 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88b41-9d83-4e6f-9606-0f7a5b9497ba service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:01.684956 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 664/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:03:03.940132 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.941030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.941030 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:03.943218 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 671/1335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:03.948715 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea16f-d1be-4a74-b554-613c03444537 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:03.949161 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea16f-d1be-4a74-b554-613c03444537 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:03.949259 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ea16f-d1be-4a74-b554-613c03444537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.018966 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-329ea16f-d1be-4a74-b554-613c03444537 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:04.020198 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-329ea16f-d1be-4a74-b554-613c03444537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:04.099888 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.132727 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 665/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:04.175170 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:04.176713 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:04.289876 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0870288-6045-4773-85f1-0a5c7de51d02 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:04.328586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:04.380246 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:04.380902 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:04.381193 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:04.381469 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:04.383181 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:04.500742 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:04.502199 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c390816-4e8b-477c-bcd5-00ed09c27851 service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:04.521034 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 672/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:03:07.230510 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.231389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.231389 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.233660 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 666/1338] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:07.242510 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d34-6400-4d8b-81f0-acfd146d7673 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.242961 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d34-6400-4d8b-81f0-acfd146d7673 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.243463 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d34-6400-4d8b-81f0-acfd146d7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.313780 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-65a18d34-6400-4d8b-81f0-acfd146d7673 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:07.315025 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-65a18d34-6400-4d8b-81f0-acfd146d7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:07.323719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.416631 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 673/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:07.456087 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:07.458506 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:07.576035 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f97d0-968d-44ea-b153-d1d0a6708d85 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:07.649149 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:07.649813 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:07.650101 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:07.650381 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:07.652059 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:07.686972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:07.767104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:07.768484 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b2e33-379e-40ff-8fe9-57058a8c1106 service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:07.794000 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 667/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:12.089901 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.090416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.090416 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.091772 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 674/1341] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:12.097315 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d421d-ed86-4938-a723-fd12086525a5 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.097765 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d421d-ed86-4938-a723-fd12086525a5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.098196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d421d-ed86-4938-a723-fd12086525a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.169724 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-6f7d421d-ed86-4938-a723-fd12086525a5 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:12.170972 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-6f7d421d-ed86-4938-a723-fd12086525a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:12.264961 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=100 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:12.279445 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 668/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:12.318135 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:12.320433 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:12.421288 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7230be1-2c2c-4573-88ef-b03c6300ca3e None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:12.425283 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:12.425941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:12.426226 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:12.426487 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:12.435910 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:12.437373 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a2361-eb96-4d15-b17a-4100fb1cccfe service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:12.447266 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 675/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:15.285761 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.286270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.286270 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.287679 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 669/1344] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:15.293000 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c69d-7c96-4551-a6de-f8a1fa2dede2 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.293494 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c69d-7c96-4551-a6de-f8a1fa2dede2 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.293586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702c69d-7c96-4551-a6de-f8a1fa2dede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.321712 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-1702c69d-7c96-4551-a6de-f8a1fa2dede2 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:15.322871 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-1702c69d-7c96-4551-a6de-f8a1fa2dede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:15.352745 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:15.406518 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 676/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:15.443687 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:15.445563 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:15.459781 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ba824-fb35-438b-96f5-73d7aff570a5 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:15.463734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:15.464384 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:15.464668 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:15.464943 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:15.474811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:15.476280 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ee286-4dd5-4dc9-a5aa-6f8b183b8df8 service neutron] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:15.485823 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 670/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:19.980029 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f7-e48f-42c1-b148-d0aa76ab5d68 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.980550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f7-e48f-42c1-b148-d0aa76ab5d68 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.980550 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f57f7-e48f-42c1-b148-d0aa76ab5d68 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:19.981924 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 677/1347] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:19.987545 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417707-4992-4547-b26a-96446568c298 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:19.987941 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417707-4992-4547-b26a-96446568c298 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:19.988113 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4417707-4992-4547-b26a-96446568c298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.007066 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-d4417707-4992-4547-b26a-96446568c298 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:20.008294 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-d4417707-4992-4547-b26a-96446568c298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:20.021319 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 671/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:20.059208 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f57f7-e48f-42c1-b148-d0aa76ab5d68 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:20.071541 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f57f7-e48f-42c1-b148-d0aa76ab5d68 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:20.076160 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de95d4bce1b742318f16a6be59eada28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:20.076838 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:20.077123 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:20.077393 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:20.087324 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:20.088785 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a543f-def3-4344-9c98-a38e1fe4b91f service neutron] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:20.099239 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 678/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:25.577599 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558882bd-8008-49e4-80e2-07fbc38780d1 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.578207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558882bd-8008-49e4-80e2-07fbc38780d1 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.578207 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558882bd-8008-49e4-80e2-07fbc38780d1 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.579936 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 672/1350] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:25.585300 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71ca1-575f-4780-b252-e797abf186c1 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:25.585753 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71ca1-575f-4780-b252-e797abf186c1 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:25.585874 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c71ca1-575f-4780-b252-e797abf186c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:25.689228 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-78c71ca1-575f-4780-b252-e797abf186c1 None None] MFA Rules not processed for user `826f55d74e104105897ed344a1b02765`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:25.690583 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-78c71ca1-575f-4780-b252-e797abf186c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:25.874589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 679/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:03:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:29.834183 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6908-ec9c-49f1-9391-e6719a677bee None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.835165 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6908-ec9c-49f1-9391-e6719a677bee None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.835602 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e6908-ec9c-49f1-9391-e6719a677bee None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.837145 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 673/1352] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:29.842337 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52506-94c6-4bc9-8883-421e1926f4a2 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:29.843151 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52506-94c6-4bc9-8883-421e1926f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:29.843639 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f52506-94c6-4bc9-8883-421e1926f4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:29.862248 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-24f52506-94c6-4bc9-8883-421e1926f4a2 None None] MFA Rules not processed for user `826f55d74e104105897ed344a1b02765`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:29.863692 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-24f52506-94c6-4bc9-8883-421e1926f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:29.872597 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 680/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:03:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:30.001546 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=13 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:31.407427 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b246b3-74c6-4cc1-89a5-d4e9a21a3ae1 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:31.408092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b246b3-74c6-4cc1-89a5-d4e9a21a3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:31.408092 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b246b3-74c6-4cc1-89a5-d4e9a21a3ae1 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:31.409559 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 674/1354] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:31.414715 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2cf7a-3333-4bea-99f9-ad3eee075d43 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:31.415140 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2cf7a-3333-4bea-99f9-ad3eee075d43 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:31.415321 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2cf7a-3333-4bea-99f9-ad3eee075d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:31.433406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-b9c2cf7a-3333-4bea-99f9-ad3eee075d43 None None] MFA Rules not processed for user `826f55d74e104105897ed344a1b02765`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:31.434603 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-b9c2cf7a-3333-4bea-99f9-ad3eee075d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:31.443441 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 681/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:03:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:35.455104 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea190-d80e-4dfb-9b56-3d5e5ece491f None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.455719 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea190-d80e-4dfb-9b56-3d5e5ece491f None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.455811 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cea190-d80e-4dfb-9b56-3d5e5ece491f None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.457143 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 675/1356] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:35.462474 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6e03-a19a-4670-9110-12bc29b04ee9 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.463299 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6e03-a19a-4670-9110-12bc29b04ee9 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.463589 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6e03-a19a-4670-9110-12bc29b04ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.484267 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-04fc6e03-a19a-4670-9110-12bc29b04ee9 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:35.485866 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-04fc6e03-a19a-4670-9110-12bc29b04ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:35.502872 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 682/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:35.551382 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc1f2e-e97c-42be-803a-568a27e9816d None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.551883 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc1f2e-e97c-42be-803a-568a27e9816d None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.552323 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc1f2e-e97c-42be-803a-568a27e9816d None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.553922 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 676/1358] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:35.562791 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb041-839d-4721-b761-454270cd3af1 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.563480 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb041-839d-4721-b761-454270cd3af1 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.563926 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cb041-839d-4721-b761-454270cd3af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.611093 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=100 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:35.624378 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-ba8cb041-839d-4721-b761-454270cd3af1 None None] MFA Rules not processed for user `a5b17626f37949c3adb553d9d4fb72fe`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:35.628447 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-ba8cb041-839d-4721-b761-454270cd3af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:35.716732 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 683/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:03:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:03:35.725275 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc1f2e-e97c-42be-803a-568a27e9816d None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:35.741832 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc1f2e-e97c-42be-803a-568a27e9816d None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:35.747606 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b17626f37949c3adb553d9d4fb72fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:35.748370 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:35.748750 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:35.749196 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:35.758894 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:35.760638 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4d595-cfce-41ad-a278-692cd33c61fe service nova] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:35.771550 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 677/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:38.210524 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a8c1-c31d-4ed6-8a3b-fd97f8a33e23 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.211104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a8c1-c31d-4ed6-8a3b-fd97f8a33e23 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.211104 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a8c1-c31d-4ed6-8a3b-fd97f8a33e23 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.212474 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 684/1361] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:38.218056 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbf0b-a5c0-4ad2-9b43-311c7068c0c3 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.218654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbf0b-a5c0-4ad2-9b43-311c7068c0c3 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.218654 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adbf0b-a5c0-4ad2-9b43-311c7068c0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.238377 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-f0adbf0b-a5c0-4ad2-9b43-311c7068c0c3 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:38.239596 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-f0adbf0b-a5c0-4ad2-9b43-311c7068c0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:38.248334 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 678/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:38.292028 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a8c1-c31d-4ed6-8a3b-fd97f8a33e23 None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:38.307072 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a8c1-c31d-4ed6-8a3b-fd97f8a33e23 None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:38.312777 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b17626f37949c3adb553d9d4fb72fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:38.313432 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:38.313976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:38.313976 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:38.322776 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:38.324406 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e80d8-ca9e-42c0-b8ad-ecb83fb32335 service nova] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:38.334372 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 685/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:40.871244 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd008c57-1d0d-4238-863e-42274e01900e None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.871812 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd008c57-1d0d-4238-863e-42274e01900e None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.871812 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd008c57-1d0d-4238-863e-42274e01900e None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.873175 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 679/1364] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:40.878981 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb42c-8d61-42ce-b97c-9797746b0d00 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.879446 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb42c-8d61-42ce-b97c-9797746b0d00 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.879719 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcb42c-8d61-42ce-b97c-9797746b0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.898122 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-a8fcb42c-8d61-42ce-b97c-9797746b0d00 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:40.899437 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-a8fcb42c-8d61-42ce-b97c-9797746b0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:40.907962 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 686/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:03:40.952439 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cbee-dbd8-43d1-9697-8ebc292354b8 None None] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.952695 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cbee-dbd8-43d1-9697-8ebc292354b8 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.953129 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100cbee-dbd8-43d1-9697-8ebc292354b8 None None] PATH_INFO: `/` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.954648 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 680/1366] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:03:40.960164 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f6dc-3a37-43b9-96e9-2abbabb96af1 None None] REQUEST_METHOD: `POST` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:40.960620 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f6dc-3a37-43b9-96e9-2abbabb96af1 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:40.961040 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f6dc-3a37-43b9-96e9-2abbabb96af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:40.980600 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.auth.core [None req-7119f6dc-3a37-43b9-96e9-2abbabb96af1 None None] MFA Rules not processed for user `a5b17626f37949c3adb553d9d4fb72fe`. Rule list: `[]` (Enabled: `True`). {{(pid=144063) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:40.982070 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.fernet_utils [None req-7119f6dc-3a37-43b9-96e9-2abbabb96af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144063) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:40.992383 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 687/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:03:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:41.000821 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cbee-dbd8-43d1-9697-8ebc292354b8 None None] Authenticating user token {{(pid=144062) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:41.016242 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100cbee-dbd8-43d1-9697-8ebc292354b8 None None] Validating token access rules against request {{(pid=144062) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:41.022952 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b17626f37949c3adb553d9d4fb72fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144062) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:41.023793 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] REQUEST_METHOD: `GET` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.024245 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.024686 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.033912 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:41.035734 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445c7ca-2873-4e30-ad6d-d6845d9ccd6b service nova] RBAC: Authorization granted {{(pid=144062) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:41.045440 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 681/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:41.727476 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a808-6d0e-419b-8d3f-3eb0fffad3c9 None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.728336 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a808-6d0e-419b-8d3f-3eb0fffad3c9 None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.728821 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a808-6d0e-419b-8d3f-3eb0fffad3c9 None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.730451 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 688/1369] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:41.737269 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137cfc8-e48b-4781-9ebd-1c2c13cdb7ec None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:41.737531 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137cfc8-e48b-4781-9ebd-1c2c13cdb7ec None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:41.738002 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137cfc8-e48b-4781-9ebd-1c2c13cdb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:41.758833 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-2137cfc8-e48b-4781-9ebd-1c2c13cdb7ec None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:41.760643 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-2137cfc8-e48b-4781-9ebd-1c2c13cdb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:41.771213 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 682/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:43.368565 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffddca4-0fb3-4381-bdba-01d8c0b4f83b None None] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.369133 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffddca4-0fb3-4381-bdba-01d8c0b4f83b None None] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.369133 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffddca4-0fb3-4381-bdba-01d8c0b4f83b None None] PATH_INFO: `/` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.370586 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 689/1371] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:03:43.376058 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce89d4-511c-4f99-bbad-a56e5788da08 None None] REQUEST_METHOD: `POST` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.376490 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce89d4-511c-4f99-bbad-a56e5788da08 None None] SCRIPT_NAME: `/identity` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.376603 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce89d4-511c-4f99-bbad-a56e5788da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144062) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.394512 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.auth.core [None req-cfce89d4-511c-4f99-bbad-a56e5788da08 None None] MFA Rules not processed for user `296d7ae67cfb462aa7db38b0f4a6b740`. Rule list: `[]` (Enabled: `True`). {{(pid=144062) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:03:43.395753 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG keystone.common.fernet_utils [None req-cfce89d4-511c-4f99-bbad-a56e5788da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144062) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:03:43.403996 dv-cinder-835881-13-smb devstack@keystone.service[144062]: [pid: 144062|app: 0|req: 683/1372] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:03:43.446909 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffddca4-0fb3-4381-bdba-01d8c0b4f83b None None] Authenticating user token {{(pid=144063) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:03:43.462024 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffddca4-0fb3-4381-bdba-01d8c0b4f83b None None] Validating token access rules against request {{(pid=144063) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:03:43.468022 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5b17626f37949c3adb553d9d4fb72fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356c82a6bb6148efb1465c9804bd681e', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144063) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:03:43.468662 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] REQUEST_METHOD: `GET` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:03:43.468941 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] SCRIPT_NAME: `/identity` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:03:43.469213 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144063) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:03:43.477850 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:03:43.479474 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a95f8c-4990-4343-97a3-e0cdb5b739ca service nova] RBAC: Authorization granted {{(pid=144063) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:03:43.489043 dv-cinder-835881-13-smb devstack@keystone.service[144063]: [pid: 144063|app: 0|req: 690/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:03:53.389317 dv-cinder-835881-13-smb devstack@keystone.service[144062]: DEBUG dbcounter [-] [144062] Writing DB stats keystone:SELECT=21 {{(pid=144062) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:03:53.485097 dv-cinder-835881-13-smb devstack@keystone.service[144063]: DEBUG dbcounter [-] [144063] Writing DB stats keystone:SELECT=54 {{(pid=144063) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:04:05.584241 dv-cinder-835881-13-smb devstack@keystone.service[144048]: Thu May 19 20:04:05 2022 - graceful shutdown triggered... May 19 20:04:05.584738 dv-cinder-835881-13-smb devstack@keystone.service[144062]: Gracefully killing worker 1 (pid: 144062)... May 19 20:04:05.584329 dv-cinder-835881-13-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:04:05.585250 dv-cinder-835881-13-smb devstack@keystone.service[144063]: Gracefully killing worker 2 (pid: 144063)... May 19 20:04:06.585524 dv-cinder-835881-13-smb devstack@keystone.service[144048]: worker 1 buried after 1 seconds May 19 20:04:06.585524 dv-cinder-835881-13-smb devstack@keystone.service[144048]: worker 2 buried after 1 seconds May 19 20:04:06.585524 dv-cinder-835881-13-smb devstack@keystone.service[144048]: goodbye to uWSGI. May 19 20:04:06.588011 dv-cinder-835881-13-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:04:06.588898 dv-cinder-835881-13-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 20:10:00.822063 dv-cinder-835881-13-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 20:10:00.831302 dv-cinder-835881-13-smb devstack@keystone.service[207413]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 20:10:00 2022] *** May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: nodename: dv-cinder-835881-13-smb May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: machine: x86_64 May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: clock source: unix May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: pcre jit disabled May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: detected number of CPU cores: 4 May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: current working directory: / May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: detected binary path: /usr/bin/uwsgi-core May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: your processes number limit is 47680 May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: your memory page size is 4096 bytes May 19 20:10:00.833211 dv-cinder-835881-13-smb devstack@keystone.service[207413]: detected max file descriptor number: 2048 May 19 20:10:00.834196 dv-cinder-835881-13-smb devstack@keystone.service[207413]: lock engine: pthread robust mutexes May 19 20:10:00.834196 dv-cinder-835881-13-smb devstack@keystone.service[207413]: thunder lock: enabled May 19 20:10:00.834196 dv-cinder-835881-13-smb devstack@keystone.service[207413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 20:10:00.834196 dv-cinder-835881-13-smb devstack@keystone.service[207413]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 20:10:00.878339 dv-cinder-835881-13-smb devstack@keystone.service[207413]: Python main interpreter initialized at 0x5635c04109c0 May 19 20:10:00.878339 dv-cinder-835881-13-smb devstack@keystone.service[207413]: python threads support enabled May 19 20:10:00.878339 dv-cinder-835881-13-smb devstack@keystone.service[207413]: your server socket listen backlog is limited to 100 connections May 19 20:10:00.878339 dv-cinder-835881-13-smb devstack@keystone.service[207413]: your mercy for graceful operations on workers is 90 seconds May 19 20:10:00.878792 dv-cinder-835881-13-smb devstack@keystone.service[207413]: mapped 403077 bytes (393 KB) for 2 cores May 19 20:10:00.878792 dv-cinder-835881-13-smb devstack@keystone.service[207413]: *** Operational MODE: preforking *** May 19 20:10:00.879062 dv-cinder-835881-13-smb devstack@keystone.service[207413]: *** uWSGI is running in multiple interpreter mode *** May 19 20:10:00.879062 dv-cinder-835881-13-smb devstack@keystone.service[207413]: spawned uWSGI master process (pid: 207413) May 19 20:10:00.879276 dv-cinder-835881-13-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 20:10:00.880352 dv-cinder-835881-13-smb devstack@keystone.service[207413]: spawned uWSGI worker 1 (pid: 207425, cores: 1) May 19 20:10:00.880352 dv-cinder-835881-13-smb devstack@keystone.service[207413]: spawned uWSGI worker 2 (pid: 207426, cores: 1) May 19 20:10:00.880352 dv-cinder-835881-13-smb devstack@keystone.service[207413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 20:10:06.480315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:10:06.480315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: from cryptography.utils import int_from_bytes May 19 20:10:06.481078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:10:06.481078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: from cryptography.utils import int_from_bytes May 19 20:10:06.520802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:10:06.520802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: from cryptography.utils import int_from_bytes May 19 20:10:06.521436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:10:06.521436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: from cryptography.utils import int_from_bytes May 19 20:10:06.530273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:10:06.530428 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:10:06.530650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] command line args: [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:10:06.530962 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:10:06.531104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ================================================================================ {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:10:06.531426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] admin_token = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.531676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] config_dir = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.531817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.532011 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] config_source = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.532221 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] debug = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.532376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.533753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.533753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] insecure_debug = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.533753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.533753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.533753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_config_append = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_dir = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_file = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.534998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.535284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.535429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.535631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.535878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.536125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.536359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.536591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.536810 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.537040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.537287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.537534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] notification_format = cadf {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.537822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.538320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.538510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] publish_errors = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.538769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.539003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.539173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.539435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.539671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.539905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] standard_threads = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.540120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] strict_password_check = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.540367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.540545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] use_eventlog = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.540722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] use_journal = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.540898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] use_json = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.541072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] use_stderr = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.541248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] use_syslog = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.541478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] watch_log_file = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.541759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.541997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.542259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.542499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.542780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.543023 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.543276 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.543513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.543776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.544025 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.544279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.544513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.544761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.544997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.545249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.545498 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.545736 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.545991 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.546248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.546493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.546750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.547007 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.547273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.547528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.547778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.548011 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.548241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.548473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.548709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.548960 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.549219 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.549450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.549681 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.549930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.550180 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.550418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.550679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.550935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.551172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.551409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.551639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.551870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.552100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.552331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.552572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.552824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.553057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.553314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.553545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.553750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.553986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.554242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.554475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.554734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.554976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.555213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.555450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.555687 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.555918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.556169 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.556407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.556644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.556875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.557135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.557528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.557767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.558006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.558244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.558558 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.558829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.559086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.559334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.559572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.559808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.560046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.560296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.enabled = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.560535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.560772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.561014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.561251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.561489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.561723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.561959 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.562195 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.562456 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.562721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.562968 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.563205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.563448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.563687 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.563924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.564161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.564395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.564627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.564860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.565096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.565338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.565581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.565820 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.566074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.566313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.566710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.566980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.567229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.567465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.external = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.567701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.mapped = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.568002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.568134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:10:06.568267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.568395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:10:06.568527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] command line args: [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:10:06.568657 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.password = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.568657 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] auth.token = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.568913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:10:06.568913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ================================================================================ {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:10:06.569154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.569282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] admin_token = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.569410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] catalog.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.569543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] config_dir = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.569677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.569805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.569933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.570060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] config_source = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.570180 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.570318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] debug = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.570318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.570577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.570752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.570886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.571022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] insecure_debug = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.571149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.571277 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.571405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.571533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.571660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.571799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.571926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.572047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_config_append = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.572047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.572300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.572427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_dir = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.572568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.572690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_file = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.572816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.572976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.573098 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.573226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.573358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.573486 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.573613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.573741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.573741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.573989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.574117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.574255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.574377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.574503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.574631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.574795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.574925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.575053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.575181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.575181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.575431 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.575556 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.575683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.575810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.575936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.576064 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] notification_format = cadf {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.576197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.576197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.576439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.576560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.576560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.576800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.576800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] publish_errors = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.577047 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.577174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.577301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.577422 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.577548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.577755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.577878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.578005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.578133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.578260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.578381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.578513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] standard_threads = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.578638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.578779 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] strict_password_check = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.578910 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.579037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.579037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] use_eventlog = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.579292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.579420 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] use_journal = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.579547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.579668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] use_json = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.579796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.579931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] use_stderr = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.579931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] use_syslog = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.580163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.580292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] watch_log_file = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:10:06.580419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.580546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.580679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.580807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581581 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.581980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582498 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.582933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.583943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584325 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584705 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.584868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.585898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586149 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586531 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.586950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.587984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588227 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.password = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588483 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588626 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.588886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.589930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.590954 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591725 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591855 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.591983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.592874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593195 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593585 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.593954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.594883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595124 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595641 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.595897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596025 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596673 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.596930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597819 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.597959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.598394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.598519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.598648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.598806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.598944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] policy.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.599969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600096 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.enabled = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] receipt.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.600919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601552 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.601935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602442 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.602890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.603913 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] revoke.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] role.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.604914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] role.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] role.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] role.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.605949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606071 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.606969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.607886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608014 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.external = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.mapped = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.608917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.password = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] auth.token = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] catalog.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609819 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.609947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610203 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.610980 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611364 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.611872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612249 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612386 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612768 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.612888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.613919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614440 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.provider = fernet {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.614977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615466 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.615988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] trust.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.616901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617791 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.617922 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.618906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.connection = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.619961 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.620963 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.621965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.622882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623501 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.623935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.password = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.624946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.625934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.626965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.627992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.629815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.630279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.630279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.630525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] policy.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.630674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.630935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.631169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.631403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] receipt.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.631646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.631868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.632106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.632335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.632567 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.632814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.633064 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.633310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.633553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.633802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.634051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.634284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] revoke.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.634529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.634790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.635028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] role.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.635294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] role.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.635558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] role.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.635787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] role.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.636034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.636285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.636532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.636780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.637026 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.637270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.637515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.637765 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.637998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.638246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.638493 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.638838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.639087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.639505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.639742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.639989 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.640237 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.640484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.640731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.640964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.641216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.641466 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.641704 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.641931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.642161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.642390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.642638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.642915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.643161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.643397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.643630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.643859 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.644091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.644327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.644575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.provider = fernet {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.644810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.645063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.645308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.645544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.645786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.646026 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.646273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] trust.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.646510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.646784 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.647021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.647260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.647500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.647735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.647978 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.648101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.648271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.648403 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.648527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.connection = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.648654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.648825 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.648997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.649234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.649473 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.649706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.649940 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.650173 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.650407 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.650646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.650926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.651166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.651397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.651645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.651878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.652119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.652358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.652597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.652831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:10:06.653001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:10:06.657318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.678320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.678523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.678811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.686326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.686534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.690290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.708888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.709088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.738583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.746474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.788854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.789063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.793981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.794189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.854385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.854579 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.854753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.854860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855214 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.855828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.878497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.878731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.878880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.879938 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.880028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.880028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.891090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.891247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.904204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.904411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.904644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.904907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.905907 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.906136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.906350 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.906568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.906785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207425) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:10:06.922809 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.923046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:10:06.923377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.923511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.923597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:10:06.923683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:10:06.923834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.923984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:10:06.924389 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.924882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.925169 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.936263 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.936543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.936809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.937092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.937369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.937642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.937905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.938179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.945268 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.946303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.948653 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.948932 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.949326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.949616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.949752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.949925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950248 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950363 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950784 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.950981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951689 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.951959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.952228 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.952492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.978542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.979443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.980273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.980550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.981049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.981327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.985915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.986202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.986478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.986624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.986890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.987168 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.993965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.994193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.994460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.994819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.998908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.999194 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.999473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.999620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:06.999769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.999871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:06.999999 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000247 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.000928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.001106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.001389 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.019565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.019842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.020105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.024409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.024898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.028109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.028398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.028583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.028902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.033407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.034028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.037029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.037642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.040835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041134 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041657 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.041945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.042070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.042218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.042308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.042518 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.042811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.061382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.061754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.062052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.062182 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.062295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.062434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.062730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.062964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.070247 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.070962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.072030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.072306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.072671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.072968 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.075411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.075693 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.075981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.076117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.076249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.076425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.076530 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.076614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.076834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.077119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.090041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.090320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.090595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.090758 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.090875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.090975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.091975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.092263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.110214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.111211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.113515 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.114485 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.116863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.117805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.118475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.119435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.120208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.120492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.120768 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.121132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.121411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.121685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.128247 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.129141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.129887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.130889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.133163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.133454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.133741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.134005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.134142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.134265 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.134578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.134871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.144092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.144370 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.144644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.144987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.145302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.145583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.152853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=207426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.153128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.153402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.153589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=207425) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:10:07.153694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.153897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154045 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.154995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155661 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.155842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=207426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.156874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.157131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=207425) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:10:07.195028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635c04109c0 pid: 207426 (default app) May 19 20:10:07.196085 dv-cinder-835881-13-smb devstack@keystone.service[207425]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635c04109c0 pid: 207425 (default app) May 19 20:10:07.198429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360789b1-3972-4a5b-aad7-1e768172cfed None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:07.198723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360789b1-3972-4a5b-aad7-1e768172cfed None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:07.199039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360789b1-3972-4a5b-aad7-1e768172cfed None None] PATH_INFO: `/v3` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:07.203396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu May 19 20:10:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:15.205851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:15.206909 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:15.206909 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:15.213967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:15.219292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:15.219769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:15.219867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:15.286910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: INFO dbcounter [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] Registered counter for database keystone May 19 20:10:15.310574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG oslo_db.sqlalchemy.engines [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=207426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:10:15.317751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writer thread running {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:10:15.508462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG passlib.handlers.bcrypt [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=207426) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:10:15.508879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG passlib.handlers.bcrypt [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=207426) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:10:15.564270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:15.565892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:15.701325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:10:15.735838 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:15.804684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: INFO dbcounter [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] Registered counter for database keystone May 19 20:10:15.826710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG oslo_db.sqlalchemy.engines [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=207425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:10:15.835042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writer thread running {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:10:15.956067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eb3de-bdce-442d-8773-d3064e2105bb None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:15.961625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf486d74afa4d19ae43e59f70caf3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:15.962300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:15.962588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:15.962897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:15.971618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:16.022769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:10:16.023048 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b36fb-3564-489c-adba-5691bfa2e1be admin admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:16.033547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 20:10:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 20:10:16.040165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:16.055632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10837bce-1f14-4697-9119-acccdfe356a2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:16.061456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf486d74afa4d19ae43e59f70caf3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:16.062599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:16.062916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:16.063193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] PATH_INFO: `/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:16.064888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] RBAC: Authorizing `identity:get_project(project_id=8bf486d74afa4d19ae43e59f70caf3c5)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:16.116888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:10:16.117225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef86c-a384-4514-90f1-5ac9c9fe3513 admin admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:16.121927 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu May 19 20:10:16 2022] GET /identity/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:18.338566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1e4-8186-4055-ad59-cda4ebd83831 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:18.339202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1e4-8186-4055-ad59-cda4ebd83831 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:18.339202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1e4-8186-4055-ad59-cda4ebd83831 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:18.343383 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:18.350534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:18.351329 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:18.351500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:18.379999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:18.381535 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:18.391995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:10:18.418151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d1e4-8186-4055-ad59-cda4ebd83831 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:18.433930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d1e4-8186-4055-ad59-cda4ebd83831 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:18.439789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf486d74afa4d19ae43e59f70caf3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:18.440436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:18.440729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:18.440994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:18.449158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:18.450982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3f8-bb5c-4afa-b403-3dd60dfc42ac admin admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:18.459866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 20:10:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:10:18.466117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:18.479681 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c5881-ca54-44a6-b846-0864fd6af79d None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:18.486574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf486d74afa4d19ae43e59f70caf3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:18.487496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:18.487782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:18.488057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:18.489538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:18.491410 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158fc3e-1317-4f11-8e3d-091b24b8e182 admin admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:18.493026 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu May 19 20:10:18 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:20.814987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c14d7-b52d-4240-a81a-7447664bc2f8 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:20.815543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c14d7-b52d-4240-a81a-7447664bc2f8 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:20.815933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c14d7-b52d-4240-a81a-7447664bc2f8 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:20.818012 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:20.823885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:20.824424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:20.824521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:20.836291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed078-4cf9-4dba-ab01-aa3b5c939cec None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:20.836703 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed078-4cf9-4dba-ab01-aa3b5c939cec None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:20.837014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed078-4cf9-4dba-ab01-aa3b5c939cec None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:20.838882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:20.844743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:20.845975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:20.846550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:20.847060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:20.847463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:20.893091 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG passlib.handlers.bcrypt [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=207425) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:10:20.893472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG passlib.handlers.bcrypt [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=207425) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:10:20.934294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:20.940625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:20.942354 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:20.958009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:20.986196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.055075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:21.074188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435def11-9a03-49c2-9232-8a3583996e5b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.077636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.112666 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.113502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.113782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.114057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.128363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:21.140107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:21.141386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:21.142755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:21.147683 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.300883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da89b1-c9d7-45bb-bcb2-71bc192c4e31 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.303422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.340233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.341399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.341688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.341973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.347405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.366147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eebf40-a22f-45d2-8423-1a4a9e55dce8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.399772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.400447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.400755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.401074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.401840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:21.402148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.403599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.410914 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.412450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.415909 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:21.422015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.520751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:10:21.523393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de75f0-7149-47d8-9951-b50b608c36aa None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.526497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.529254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.558497 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.559411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.559697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.559971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.561208 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.562715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.564383 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:21.569806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.584900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.632771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ea87-d6e6-46f1-b450-f5541e84ba39 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.666259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.667163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.667443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.667719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.671522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f67bf5-0fdd-4de2-984c-6ac3a7685561 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.686425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.687926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.706477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.707322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.707608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.707886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:10:21.708641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:21.709529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:21.710413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:10:21.710413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:10:21.710413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:10:21.710413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:21.710652 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.710773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:21.710860 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.712351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:21.716034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.717597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:21.777459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.799762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:21.820893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c7258-6ddd-432d-8880-f03cf8bb5853 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.822342 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371100-867a-4ea0-9b20-560280551bfd None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:21.857257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.857926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.858050 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:21.858228 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.858494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.858720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:21.859027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:21.859311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:21.859408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.domain.id=default, user.id=a341201fe78a44788ba60279420a0db2) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:21.859691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.860062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:21.860376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:21.861147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdea707-0c7d-4e26-bb07-62045e935ffa None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.861764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34c83-adc5-457b-bb5c-8e4db48e220d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:21.868009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/role_assignments?user.id=a341201fe78a44788ba60279420a0db2&scope.domain.id=default&role.id=3d4222f61d774512b154900643156352 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:21.880598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:24.514091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa007f8-0848-4636-87a2-e1c0d40dc80f None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.514610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa007f8-0848-4636-87a2-e1c0d40dc80f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.515005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa007f8-0848-4636-87a2-e1c0d40dc80f None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.517184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:24.525990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.526573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.527020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.551682 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:24.552891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:24.635571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d833-2869-4948-b873-ec7f8501c4a3 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.635905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d833-2869-4948-b873-ec7f8501c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.636187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d833-2869-4948-b873-ec7f8501c4a3 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.637602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 13/23] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:24.645738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 11/24] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:24.649668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183d75-a950-4fc9-b4b7-bebf7c853073 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.649964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183d75-a950-4fc9-b4b7-bebf7c853073 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.650253 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58183d75-a950-4fc9-b4b7-bebf7c853073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.679720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-58183d75-a950-4fc9-b4b7-bebf7c853073 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:24.680956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-58183d75-a950-4fc9-b4b7-bebf7c853073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:24.704828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:24.782146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 14/25] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:24.783630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f24e-e06b-4a87-b1b6-13313a84a627 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.783928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f24e-e06b-4a87-b1b6-13313a84a627 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.784213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f24e-e06b-4a87-b1b6-13313a84a627 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.785812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 15/26] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:24.799583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:24.801544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.802100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.802100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.834598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:24.835919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:24.908641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2576-8933-46f2-bd85-0091f53514bd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:24.947616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:24.948581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.948934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.949232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:24.957950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 16/27] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:24.958597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:24.960896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:24.962411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:24.973001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f84be2a2-a68d-48bd-a959-e0360fecb645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:10:24.992084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:24.993249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:24.994339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:10:24.994339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:10:24.994339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:10:24.994339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:24.994339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 12/28] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:24.994765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002346c7-b979-4c0a-a3f7-ce3d14e987cb None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:24.995787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002346c7-b979-4c0a-a3f7-ce3d14e987cb None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:24.995787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002346c7-b979-4c0a-a3f7-ce3d14e987cb None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.000015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 13/29] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:25.000015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002346c7-b979-4c0a-a3f7-ce3d14e987cb None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.106546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdacafa-2569-4436-9e0b-ca2a6fc19393 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.137108 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:25.142081 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002346c7-b979-4c0a-a3f7-ce3d14e987cb None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.153161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.154381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.154953 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.155442 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.166945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:25.175651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:25.176601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:25.177449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:25.178881 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.179564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.179851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.180128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.180869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 17/30] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:25.180974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.182082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.182410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aa8a9-36f2-4e49-884d-3310926dea4b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.250421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:25.290663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f765026-8baa-4a8b-8a99-6af49ca6e769 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.322568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 14/31] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:10:24 2022] POST /identity/v3/roles => generated 219 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:25.324691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.325083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.325464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.327380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.328289 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.328743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.329181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.330111 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:25.330588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.332492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.344758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:25.346220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:25.354405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 18/32] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:25.359890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.424112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:25.424985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.491936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e5c8-0ae1-4915-9690-2fd11d66e3d8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.536576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:25.557155 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.558004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.558282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.558571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.559522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:25.559793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.561224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.566868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:25.583946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 19/34] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:25.584637 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.586515 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31072fb5-64cd-4ed1-ba25-7d8660a4b5dc None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.668539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.669155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.669444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.669736 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.671295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.674096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.721815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 16/35] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:10:25 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:25.722701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.778451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd217b-3d37-44fe-9843-fdafd00b945d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.841259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.842417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.842900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.843332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.844408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.846263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c495b3-0021-490f-85c4-e9f9d357a8fc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.848951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5fdad-1a2c-451f-9a33-7152f37b54e3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:25.894713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:25.894713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:25.894713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:25.894713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:25.895185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:25.896550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:25.898580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 17/36] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:25 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:25.903963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:25.931176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:26.013570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b4d7a-249f-4c66-b1a2-a005d10323b4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:26.050098 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 20/37] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:10:25 2022] POST /identity/v3/roles => generated 225 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:26.050857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:26.051679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.051800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0690d-2aa5-4d65-baa9-fa7fba9f71a3 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.051983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.052096 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0690d-2aa5-4d65-baa9-fa7fba9f71a3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.052254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.052355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0690d-2aa5-4d65-baa9-fa7fba9f71a3 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.053863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 21/38] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:26.059851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:26.060057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.060165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.060415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.061367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:26.063489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 18/39] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:26.071026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:26.081982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:26.083657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:26.144932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:26.178521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 22/40] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:26.183212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:26.205489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:26.206594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b46a36-968a-4af9-bb4e-9a3fe050e26f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:26.254365 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:26.255320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.256036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.256332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] PATH_INFO: `/v3/domains/default/users/a341201fe78a44788ba60279420a0db2/roles/3d4222f61d774512b154900643156352` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.259253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a341201fe78a44788ba60279420a0db2, role_id=3d4222f61d774512b154900643156352)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:26.262148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d85be8-b593-458b-9169-287b4659aa04 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:26.283206 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 19/41] 10.222.0.77 () {58 vars in 1361 bytes} [Thu May 19 20:10:26 2022] PUT /identity/v3/domains/default/users/a341201fe78a44788ba60279420a0db2/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:10:26.331443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50ada-7638-4555-be3b-aeef4d9c26c8 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.331782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50ada-7638-4555-be3b-aeef4d9c26c8 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.332014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a50ada-7638-4555-be3b-aeef4d9c26c8 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.333409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 20/42] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:26.333880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37eb88-0496-47b0-b2d0-f1773701fc1b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:26.339425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.339713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.339994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.362868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:26.364115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:26.380764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:26.381797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.382309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.382599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.383548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:26.385398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:26.405435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 23/43] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:10:26 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:10:26.452204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 21/44] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:26.477732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:26.520523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:26.591931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97841-9f01-48bf-8e40-a7fff9f74c4a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:26.628742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:26.629565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.629848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.630127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.631403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:26.632872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783d7d7-aef5-48d6-a2fb-e4c0a90dfa51 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:26.634726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 24/45] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:26.640387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:26.706299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:26.743741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc27e37-ad4e-4fd2-8028-bdd285c13970 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:26.779179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:26.779863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:26.780155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:26.780432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:26.781181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:26.782664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b000ec-b278-4d42-852c-b13105e6290f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:26.818711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 22/46] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:10:26 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:28.524855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ac1c-014e-4b45-ab70-90cb6666813c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:28.525456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ac1c-014e-4b45-ab70-90cb6666813c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:28.525456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ac1c-014e-4b45-ab70-90cb6666813c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:28.526859 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 25/47] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:28.532300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:28.532730 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:28.532948 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:28.550865 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:28.552080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:28.622732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 23/48] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:28.645930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ac1c-014e-4b45-ab70-90cb6666813c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:28.752380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ac1c-014e-4b45-ab70-90cb6666813c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:28.754752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:28.787788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598923-4268-42ac-804c-35a39508641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:28.788594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598923-4268-42ac-804c-35a39508641d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:28.788885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598923-4268-42ac-804c-35a39508641d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:28.789165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598923-4268-42ac-804c-35a39508641d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:28.799310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b598923-4268-42ac-804c-35a39508641d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3b598923-4268-42ac-804c-35a39508641d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:28.807135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:28.808239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:28.809083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 26/49] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:28.814234 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:28.868796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:28.923548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68add3-705b-4a37-9054-b4f149754baf None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:28.960400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:28.961087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:28.961379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:28.961666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:28.962430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:28.962775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:28.964267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc196d-08e5-4f92-a7fe-4dbecc007fae None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:28.976564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 24/50] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:28.982318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598923-4268-42ac-804c-35a39508641d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:29.024785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d64c3-6633-43b2-a4f5-fc35d84eff66 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.025002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d64c3-6633-43b2-a4f5-fc35d84eff66 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.025363 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d64c3-6633-43b2-a4f5-fc35d84eff66 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.026962 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 25/51] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:29.031956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.032252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.032538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.050843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:29.052096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:29.087489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598923-4268-42ac-804c-35a39508641d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:29.128470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:29.129382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 26/52] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:29.129533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.129636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.129912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.131279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:29.132666 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:29.134337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 27/53] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:28 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:29.139822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:29.152442 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:29.181282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:29.184798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:29.240790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513454c-28f0-43f0-a8ab-a8b25c0b5f03 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:29.258558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2d39-313d-4bc9-8890-f78eb0f4560f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:29.275933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:29.276941 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.277228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.277500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.278734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:29.280222 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:29.281849 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 27/54] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:29.287654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:29.292655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:29.293462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.293752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.294092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.295327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:29.296792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:29.298431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 28/55] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:29.303806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:29.385376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668eca-af01-425e-9d1a-c8a169cb8e44 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:29.394710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:29.398603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:29.401524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc76e7e-cdfb-4417-a236-d2ce178c63c4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:29.419689 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:29.420356 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.420641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.420920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.421778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.domain.id=default, user.id=a341201fe78a44788ba60279420a0db2) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:29.422092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:29.423578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4338ac-0b9c-4316-bcc8-f174c883e17a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:29.431590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 28/56] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 20:10:29 2022] GET /identity/v3/role_assignments?user.id=a341201fe78a44788ba60279420a0db2&scope.domain.id=default&role.id=3d4222f61d774512b154900643156352 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:29.434737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:29.435423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:29.435715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:29.435999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:29.436738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:29.438234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ad5c4-16d8-4d5d-b80b-2b28b674acd8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:29.468044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 29/57] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 20:10:29 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:10:31.684879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a643-86c9-443b-b27d-ca8a7a21597b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:31.685438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a643-86c9-443b-b27d-ca8a7a21597b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:31.685438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a643-86c9-443b-b27d-ca8a7a21597b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:31.686880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 29/58] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:31.693264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:31.694145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:31.694145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:31.713804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:31.715060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:31.785847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 30/59] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:31.811334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3a643-86c9-443b-b27d-ca8a7a21597b None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:31.932158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3a643-86c9-443b-b27d-ca8a7a21597b None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:31.967900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:31.968702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:31.968989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:31.969279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:31.970622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:31.972130 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105b5a-1b54-47c7-a2e6-9b5a8a5e8ae5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:31.974097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 30/60] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:31.980711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:32.080780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:32.104047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36d5e-30ed-4f5a-9382-4d1c4f3ed3f8 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:32.145378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:32.146076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:32.146331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:32.146646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:32.147431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:32.148927 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a08f31-35a6-4f3b-a474-b75e2eca8b50 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:32.179262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 31/61] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:31 2022] POST /identity/v3/users => generated 275 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:35.439757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833b39-cdc5-448f-9929-71ff4b07956e None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.440291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833b39-cdc5-448f-9929-71ff4b07956e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.440291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23833b39-cdc5-448f-9929-71ff4b07956e None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.441687 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 31/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:35.447268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329fd5-1050-4bf9-b63a-f84ca5766c32 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.448145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329fd5-1050-4bf9-b63a-f84ca5766c32 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.448639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63329fd5-1050-4bf9-b63a-f84ca5766c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.476000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-63329fd5-1050-4bf9-b63a-f84ca5766c32 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:35.477600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-63329fd5-1050-4bf9-b63a-f84ca5766c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:35.569104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 32/63] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:35.599350 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833b39-cdc5-448f-9929-71ff4b07956e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:35.662953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:35.711619 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762b4-837c-4423-bd80-41131aa4e958 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.711819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762b4-837c-4423-bd80-41131aa4e958 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.712210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244762b4-837c-4423-bd80-41131aa4e958 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.713748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 33/64] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:35.726629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106a49-fad7-486f-bc7a-d7d63ccc17da None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.726949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106a49-fad7-486f-bc7a-d7d63ccc17da None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.727240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106a49-fad7-486f-bc7a-d7d63ccc17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.735610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23833b39-cdc5-448f-9929-71ff4b07956e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:35.763824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-20106a49-fad7-486f-bc7a-d7d63ccc17da None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:35.765062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-20106a49-fad7-486f-bc7a-d7d63ccc17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:35.781786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:35.783307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.783607 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.783896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.807972 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-9a372fc6-69f5-47b8-8408-e5d2052f9284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:35.817594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:35.818676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:35.819580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 32/65] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:35.820271 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe1a8-84f6-413a-891d-73f78150e047 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.821129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe1a8-84f6-413a-891d-73f78150e047 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.821129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fe1a8-84f6-413a-891d-73f78150e047 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.822098 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 33/66] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:35.827103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fe1a8-84f6-413a-891d-73f78150e047 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:35.857618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:35.866505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 34/67] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:35.868305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.868893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.869344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.891145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:35.893191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:35.935118 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:35.939246 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fe1a8-84f6-413a-891d-73f78150e047 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:35.977207 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 35/68] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:35.978601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:35.983298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:35.984159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:35.984551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:35.984916 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:35.985796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:35.986189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:35.987950 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.006214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 34/69] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.012075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.088273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3029336-5237-4f51-8432-eb25ed3ff0ca None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.116796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.122161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d5ad6-3cb4-4619-a021-f6a60462a988 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.126444 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.127528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.127995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.128448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.139674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:36.147873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:36.148799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:36.149633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:36.152153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 36/70] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:36.153257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.160781 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.161693 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.161982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.162269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.180651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.182175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.184198 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 35/71] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:36.184801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.212994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.262368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882328-be8b-423a-9d05-140c23a49b03 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.298269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.298947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf58c-e58c-4c42-bfd6-89b67c01b055 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.299171 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.299425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.299707 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.312469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-aca10054-279c-4703-ac8f-67b21e4b29c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:36.320627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:36.321597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:36.322484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 37/72] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:36.323783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c766f-0721-474d-b427-07363e100c28 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.323863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c766f-0721-474d-b427-07363e100c28 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.324181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c766f-0721-474d-b427-07363e100c28 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.325387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 38/73] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:36.326142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c766f-0721-474d-b427-07363e100c28 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.343315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.344010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.344301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.344584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.345367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:36.345683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.347136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.356374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 36/74] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.361509 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.385908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.436384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c766f-0721-474d-b427-07363e100c28 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.444341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.465533 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d35bfc-226a-451e-b2eb-8aac1c1a3154 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.474918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.475593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.475882 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.476164 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.502614 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.503323 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.503613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.503944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.504850 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:36.504966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.513635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e3f42-c633-43b8-b582-0d4c1c75645e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.527524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 37/75] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.529215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.529516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.529797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.548447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:36.549656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:36.551862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.553616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c902f-d956-44f7-88a2-2d6cdc1e04ca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.603061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.620373 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 38/76] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:36.621227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.664119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 39/77] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:36.665481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff291d-c087-4161-a58f-2ffd2bb6a9a2 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.665776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff291d-c087-4161-a58f-2ffd2bb6a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.666121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff291d-c087-4161-a58f-2ffd2bb6a9a2 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.667618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 40/78] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:36.668161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff291d-c087-4161-a58f-2ffd2bb6a9a2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.701506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.727768 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3303013-b8e3-45c8-b650-56230fa93438 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.761040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.761936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.762220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.762512 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.763843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.765240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.766922 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 39/79] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.767673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.779668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff291d-c087-4161-a58f-2ffd2bb6a9a2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.813396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.814283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.814577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.814899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.816134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.817607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 41/80] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.820079 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:36.837453 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.874897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db597714-8dc5-4e26-beda-b72c907ce239 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.908258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.909078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.909370 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.909658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.919253 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2b35b-97a6-4f00-b0ff-7166e105c8e5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:36.919936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-593ff40e-6c74-40b7-9bb1-77444c5ff6a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:36.927789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:36.928759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:36.930026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 40/81] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:36.930795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.930795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.930795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.935713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:36.948434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:36.949659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:36.957693 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:36.958586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:36.959263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:36.959525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:36.961009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:36.962589 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:36.964341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 42/82] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:36.969288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.019695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 41/83] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:37.020476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.066549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.082441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a895be7-8a31-4d1a-ae98-71646874dab9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.118426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.119160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.119456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.119751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.119961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a0524-2d92-48e3-a5d1-e64129e4dfd3 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.149842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.156147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.156811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.157095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.157371 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.187526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.189076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.224445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.225923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.271967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.289402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 43/84] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:37.294902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.324123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 42/85] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:37.324965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.355995 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.399497 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986835f5-83e2-4302-86da-2545c8066050 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.424476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d1acc-93a7-4eca-ab89-6ddb5591ab5a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.434079 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.434783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.435068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.435346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.436117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:37.436430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.437853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.446183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 44/86] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.447230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.457589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.458263 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.458544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.458844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.459816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:37.460125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.461581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.467156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 43/87] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.467944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.509929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.570257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261839-8e11-40e4-a53f-c5c210f53a0e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.592142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.602475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16baf-4f48-4fdb-b148-13f55d77e3f4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.613194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.614073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.614372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.614655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.616006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.617753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.619479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 45/88] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.620108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.648397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.649292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.649583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.649868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.651233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.652715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.658862 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 44/89] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.658862 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.729441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5f76-ce53-401b-beca-32812e3d4b13 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.744568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.764668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c1f66-47f8-45ac-927f-74bc7e6fb80e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.766550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.767578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.767871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.768151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.769367 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.770936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.773072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 46/90] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.778481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.799823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.800722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.801017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.801283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.802527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.804012 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.806726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 45/91] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.806726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.839932 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:37.895941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309e18c-2c63-4c36-9924-776c137c0253 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.930942 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff8f-0d3d-4dab-b40c-d4de114910e2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:37.934165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.934514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.934828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.935105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.935831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.937290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.958550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 47/92] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:37 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:37.968178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:37.969127 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:37.970035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:37.970514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:37.971051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:37.972678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=a341201fe78a44788ba60279420a0db2) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:37.973589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:37.975562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:37.982721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 46/93] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/role_assignments?user.id=a341201fe78a44788ba60279420a0db2&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:37.983952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:38.023855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:38.109481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044541-7b2f-4bf1-9bc9-20dba610e32f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:38.161539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:38.162317 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:38.162633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:38.163107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:38.164034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:38.164342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:38.165828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:38.181669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 48/94] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=c648a19d06904216a8c19d1bf459539b => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:38.209802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:38.216265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cb13d-36da-4fa3-a359-e67941e29598 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:38.261161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:38.261861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:38.262148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:38.262431 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:38.348042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:38.349986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:38.454261 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:38.460412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 47/95] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:38.466375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:38.584654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c448-951e-477d-8ecc-ae49762f7ca6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:38.586349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:38.629889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:38.630957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:38.631364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:38.631703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] PATH_INFO: `/v3/projects/5243d31983304136a4a3c52199b78e6d` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:38.632956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] RBAC: Authorizing `identity:get_project(project_id=5243d31983304136a4a3c52199b78e6d)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:38.634445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea3363-78c2-4320-8422-c5dfa5a38ddb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:38.636429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 49/96] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:38 2022] GET /identity/v3/projects/5243d31983304136a4a3c52199b78e6d => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:38.642594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:38.762570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b4dc6-4c83-4858-90a4-69f6864d6b20 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:38.805746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:38.806429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:38.806810 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:38.807099 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:38.807979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=5243d31983304136a4a3c52199b78e6d, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:38.808302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:38.809779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c7478-b0a5-4d15-a198-1a19883ffbba None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:38.818989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 48/97] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:38 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=5243d31983304136a4a3c52199b78e6d&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:40.485665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b00-edf6-4d5e-869c-101acddd5b10 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:40.486230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b00-edf6-4d5e-869c-101acddd5b10 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:40.486230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b00-edf6-4d5e-869c-101acddd5b10 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:40.487631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 50/98] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:40.493073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b805e3-e8fd-4985-8d48-16a5ad44c9f2 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:40.493913 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b805e3-e8fd-4985-8d48-16a5ad44c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:40.494438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b805e3-e8fd-4985-8d48-16a5ad44c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:40.530550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-21b805e3-e8fd-4985-8d48-16a5ad44c9f2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:40.532165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-21b805e3-e8fd-4985-8d48-16a5ad44c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:40.606226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:40.624542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 49/99] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:40.657410 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792b00-edf6-4d5e-869c-101acddd5b10 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:40.752084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ced78-35f2-4387-8f73-076ef03e77e7 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:40.752302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ced78-35f2-4387-8f73-076ef03e77e7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:40.752553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ced78-35f2-4387-8f73-076ef03e77e7 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:40.754087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 50/100] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:40.766604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:40.766928 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:40.767194 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:40.790542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:40.791861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:40.829250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792b00-edf6-4d5e-869c-101acddd5b10 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:40.892191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:40.893499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:40.894057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:40.894557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:40.909791 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 51/101] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:40.914082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:40.922269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:40.923335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:40.924303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:40.926847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 51/102] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:40.932963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:40.948771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.005364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.113115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d580dc-6f87-4634-a10c-5c6dce7c6489 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.131860 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace5421-9209-4713-90e6-49dd975e93e8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.149404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.180506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.182539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.183313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.184596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.186272 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:41.187002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.189605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.201755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.203002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.203519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.204030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.206615 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 52/103] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:41.219867 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.231439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:41.239675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:41.240654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:41.241516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:41.249650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 52/104] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:41.257037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.353436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac99a-149d-402d-9ed9-74898fc4a3cf None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.394300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.395220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.395755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.396226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.398672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.401427 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fe32f-444e-482d-bacf-5ee8ca654d32 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.403538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 53/105] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:41.406246 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71248ce-efbc-4a11-be11-490a390ebbaa None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.407572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71248ce-efbc-4a11-be11-490a390ebbaa None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.409989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71248ce-efbc-4a11-be11-490a390ebbaa None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.413831 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 54/106] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:41.419056 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71248ce-efbc-4a11-be11-490a390ebbaa None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.497361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7e27-3852-4b7e-ac71-2e764ba221a5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.502753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.537830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.554484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.555465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.555922 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.556453 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.557442 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:41.557914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.559527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081bd4-0b9f-431a-bdc3-1dac058315c0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.568074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 53/107] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:41.569627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.570073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.570503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.587643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:41.589140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:41.597455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71248ce-efbc-4a11-be11-490a390ebbaa None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.635055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.637390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.638084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.638589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.640578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.642395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5797cd-e6ea-4262-b92a-29fe68b278dd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.645293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 55/108] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:41.651595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a9db-df1e-460b-b5d5-624f67c403ae None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.652162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a9db-df1e-460b-b5d5-624f67c403ae None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.652760 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a9db-df1e-460b-b5d5-624f67c403ae None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.654430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 56/109] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:41.655436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6a9db-df1e-460b-b5d5-624f67c403ae None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.662802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 54/110] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:41.663649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.755683 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.774367 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff36622-439b-4f78-98bd-642460fd9604 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.779536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6a9db-df1e-460b-b5d5-624f67c403ae None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:41.800871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:41.809851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.810807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.811101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.811375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.813427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, user_id=1154fafd1d0b4e98bf95cfa4d6a10d05, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.814944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9143a-cb25-4926-8c1f-d8bed34b89e0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.823373 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:41.824728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.825355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.825815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.827391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:41.829203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:41.836458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 55/111] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:41 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:10:41.836458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:41.836458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:41.836458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:41.836897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 57/112] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:41.838762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:41.868592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:41.869863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:41.952813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 56/113] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:41.953661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.010211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924950f-3f3b-44d2-a500-07858143e395 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.060178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.064557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.065402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.066137 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.066410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.079413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-9d7abd5a-27ed-44dc-85d9-33113cebd642 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:42.088573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:42.089741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:42.090787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:42.093041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 58/114] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:42.094788 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49266f-5a47-47fc-8940-ed01027f8db7 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.095392 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49266f-5a47-47fc-8940-ed01027f8db7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.095829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49266f-5a47-47fc-8940-ed01027f8db7 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.097328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 59/115] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:42.098483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49266f-5a47-47fc-8940-ed01027f8db7 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.103879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fd4db-1ceb-45a8-94ba-258e6283ab6c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.140411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.141299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.141581 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.141857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.144359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.145839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.147811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 57/116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:41 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:42.148396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.165640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.251302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49266f-5a47-47fc-8940-ed01027f8db7 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.280061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb25994-be77-430e-b5fa-cdcb465fae1c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.314045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.314879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.315178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.315463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.316780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.318481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d17db-f96c-4d55-bf5a-442f75948e6e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.320337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 60/117] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:42.321892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.322221 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.322508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.322623 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.323378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.323737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.324178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.325101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:42.325477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.326991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.336102 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 58/118] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:42.341155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:42.341712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.342372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:42.344781 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.417708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 61/119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:42.422911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.460459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7ce8-1748-497a-b27a-41fda88ead3d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.491943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.502645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.503586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.503869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.504142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/a341201fe78a44788ba60279420a0db2/roles/3d4222f61d774512b154900643156352` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.506302 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, user_id=a341201fe78a44788ba60279420a0db2, role_id=3d4222f61d774512b154900643156352)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.507812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.522727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 59/120] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:42 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/a341201fe78a44788ba60279420a0db2/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:10:42.528201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.564232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d8bf2-2a0c-42de-a087-9d06080ca0c0 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.611335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.616343 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.617279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.617664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.618259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.619846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.622237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.656145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 62/121] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:10:42 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:42.657267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.667664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae35a80-72cc-40b3-8f5e-58bee2a67020 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.714733 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.715942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.716481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.717004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.718823 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.720735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde587d-f6c0-4eeb-9890-70de5c516125 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.722925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 60/122] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:42.725709 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811109d9-3e44-442c-abb3-ba3818444f68 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.726325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811109d9-3e44-442c-abb3-ba3818444f68 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.726995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811109d9-3e44-442c-abb3-ba3818444f68 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.729082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 61/123] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:42.730230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811109d9-3e44-442c-abb3-ba3818444f68 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:42.793293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.802349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff424aa0-9a28-4215-b6c8-f0dcbb871de9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.852135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.853061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.853722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.854270 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.868352 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811109d9-3e44-442c-abb3-ba3818444f68 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:42.869634 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d81a6cda-2e57-4e03-926f-9062309d7ea5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:42.880688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:42.881804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 63/124] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:42.887192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.888024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.888024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.909606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:42.911524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:42.912976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:42.919984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:42.921176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:42.921661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:42.922123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:42.923602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:42.925432 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:42.927554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 62/125] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:42.928697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.020719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 64/126] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:43.021663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.055129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5920b-4ce1-4023-a963-d39b254a8269 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.102906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.103687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.103977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.104255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.105781 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:43.105781 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.107025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.116531 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 63/127] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:43.121258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.128943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.145366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b0002-ad5c-42b7-a715-70e91638aa2e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.188691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.211428 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.212748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.213262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.213753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.227520 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, user_id=1154fafd1d0b4e98bf95cfa4d6a10d05, role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.229327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.239813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc257c5-09fc-42df-a2f6-268ee0e007cc None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.257129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 65/128] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:43 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/c648a19d06904216a8c19d1bf459539b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:10:43.262713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.303847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.305051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.305520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.306009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.339984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:43.354797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:43.355842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:43.356708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:43.359032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 64/129] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:43.365238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.428758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1fc8-8065-4e41-9f37-adde9a1f217d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.483959 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.484870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.485164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.485455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] PATH_INFO: `/v3/users/80dc438c2f794d349aa3ab63b15e732d` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.500207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] RBAC: Authorizing `identity:get_user(user_id=80dc438c2f794d349aa3ab63b15e732d)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.501706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.503549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 66/130] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/users/80dc438c2f794d349aa3ab63b15e732d => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:43.509217 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.513154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.604371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526719d1-9041-4fe4-a418-0a351c21f1ce None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.624786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aee70-54eb-40d1-b782-347533bb5894 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.631900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.652282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.653040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.653335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.653616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.654424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:43.654832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.656722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.660291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.660971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.661262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.661544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.669061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 65/131] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:43.676309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.733575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.735131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.738020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.792116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dff80-33df-4c37-b9d1-d38a1dc6f677 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.828931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.829939 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.830286 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.830573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:43.831866 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:43.833593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:43.835296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 66/132] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:43.840834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.853434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 67/133] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:10:43.859373 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:43.896115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.954091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e2b5-5ebc-4048-ae79-31a8eb8a2894 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.960216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dfeb3-7d60-42c8-8e1c-9ee34761c6ef None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:43.962964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:43.997284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:43.999018 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:43.999509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:43.999956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] PATH_INFO: `/v3/projects/5243d31983304136a4a3c52199b78e6d` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.001364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] RBAC: Authorizing `identity:get_project(project_id=5243d31983304136a4a3c52199b78e6d)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:44.003051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:44.005101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 67/134] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/projects/5243d31983304136a4a3c52199b78e6d => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:44.010921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:44.014530 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:44.015905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:44.015905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:44.016145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.017375 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:44.018891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:44.020728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 68/135] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:43 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:44.026736 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:44.122850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1f94-deb0-4153-b28c-50319277a073 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:44.142365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:44.162350 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:44.163667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:44.164168 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:44.164603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] PATH_INFO: `/v3/projects/5243d31983304136a4a3c52199b78e6d/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.166985 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] RBAC: Authorizing `identity:create_grant(project_id=5243d31983304136a4a3c52199b78e6d, user_id=1154fafd1d0b4e98bf95cfa4d6a10d05, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:44.168679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9564e-74bd-4c7a-80b3-3a4415c1f353 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:44.187267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5969a-25c6-474f-8d0a-4e3a13518d8b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:44.192651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 68/136] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:44 2022] PUT /identity/v3/projects/5243d31983304136a4a3c52199b78e6d/users/1154fafd1d0b4e98bf95cfa4d6a10d05/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:10:44.225475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:44.226171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:44.226462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:44.226782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.227708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=80dc438c2f794d349aa3ab63b15e732d) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:44.228035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:44.229608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc813c3-1dab-4cbd-aea9-b52ff965998a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:44.236181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 69/137] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:44 2022] GET /identity/v3/role_assignments?user.id=80dc438c2f794d349aa3ab63b15e732d&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:44.895823 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5298-c2cc-45d6-9f50-64c0bba0549e None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:44.896904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5298-c2cc-45d6-9f50-64c0bba0549e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:44.897427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d5298-c2cc-45d6-9f50-64c0bba0549e None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.899086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 69/138] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:44.905050 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:44.905888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:44.906401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:44.931775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:44.933377 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:44.967674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:45.021590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 70/139] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:45.060724 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d5298-c2cc-45d6-9f50-64c0bba0549e None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:45.196541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d5298-c2cc-45d6-9f50-64c0bba0549e None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:45.242534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:45.243783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:45.244337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:45.244835 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:45.256454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:45.264691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:45.265668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:45.266551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:45.269080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 70/140] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:45.275231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:45.411723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80537acb-d843-4b70-bac2-8d03c26f2920 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:45.455017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:45.456153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:45.456654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:45.457135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:45.458131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:45.458665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:45.460310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:45.482720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 71/141] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:45.488179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:45.544193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:45.617510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899b1a1-55b6-400d-879e-19e51307d8c8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:45.653245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:45.654526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:45.655072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:45.655571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:45.657005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:45.658732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:45.660951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 71/142] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:45 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:45.666450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:45.698273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:45.801632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2149-ac7d-4d30-9a45-05639c2fc0f7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:45.836931 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:45.837602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:45.837925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:45.838204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:45.906700 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:45.908189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ff5d-1f85-46e0-bc3e-0431510a90b5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:45.935442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:46.029830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 72/143] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:46.035339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.069063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6a54-cbbf-4cb6-8c76-5a29bc3a2bb8 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.069264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6a54-cbbf-4cb6-8c76-5a29bc3a2bb8 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.069528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6a54-cbbf-4cb6-8c76-5a29bc3a2bb8 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.070988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 73/144] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:46.076707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.076983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.077264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.100356 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:46.101058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:46.196680 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c874b-10fe-4fab-b454-3b3ebc9c3c4e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.211145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:46.225511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 74/145] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:46.238471 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:46.239682 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.240278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.240889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.242932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:46.245798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:46.248083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 72/146] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:46.255804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.271908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.378670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:46.441894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac2bd4-1dca-4fe0-8dff-d0734a3bdb73 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.463326 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571da061-c7b1-47f2-90bc-7b278f747c49 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.478585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:46.479430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.479814 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.480191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.481248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:46.481663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:46.483393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e084e8-c3d7-42a8-b66f-76becb9bc6d0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:46.490412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 75/147] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:46.522337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8bd63-3dd3-41bb-899b-f171cc451e31 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.522650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8bd63-3dd3-41bb-899b-f171cc451e31 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.523105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8bd63-3dd3-41bb-899b-f171cc451e31 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.524663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 76/148] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:46.530549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.530961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.531309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.533995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:46.534949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.535247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.535562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.550447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:46.551887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:46.567620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:46.575839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:46.576945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:46.577836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 73/149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:46.583603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.624712 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 77/150] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:46.650026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.670966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:46.714561 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:46.770065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c444d46-800a-4425-9f7b-81b1538baebb None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.812802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:46.813047 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.813293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.813526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.826546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:46.833788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cbabe-739a-4397-bbb4-e8a7b0ec903e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:46.838709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:46.839766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:46.840655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 78/151] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:46.844511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.904044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:46.905176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.905663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.906148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.907154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:46.907777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:46.909470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959c8cb-c7ed-4437-be63-dee1e392dd0d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:46.922341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 74/152] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:46.923757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261581-7392-47a7-8361-1f3583388f54 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:46.924115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261581-7392-47a7-8361-1f3583388f54 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:46.924401 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67261581-7392-47a7-8361-1f3583388f54 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:46.929965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 75/153] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:46.930854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261581-7392-47a7-8361-1f3583388f54 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:46.965596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78e531-0014-4b8e-a335-20615e0f6612 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:46.982105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.012809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.013517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.013804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.014083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.014905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:47.015314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.016750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f222-320d-45e7-9637-e58ad98719af None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.029163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 79/154] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:47.030892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.031174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.031457 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.047558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.053075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:47.054896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:47.055218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67261581-7392-47a7-8361-1f3583388f54 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.103999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.105053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.105391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.105671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] PATH_INFO: `/v3/users/a341201fe78a44788ba60279420a0db2` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.107665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] RBAC: Authorizing `identity:get_user(user_id=a341201fe78a44788ba60279420a0db2)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.109145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.115786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 76/155] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:46 2022] GET /identity/v3/users/a341201fe78a44788ba60279420a0db2 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:47.115786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.153015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 80/156] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:47.154298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.257400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211518ac-06c8-40ad-b38e-393495fbcff2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.300357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ecd2-24f7-4f0b-aad2-68e60c90269c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.304314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.308127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.309071 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.309358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.309634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.310903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.312369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.315536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 77/157] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:47.316322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.352895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.363453 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.364133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.364423 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.364699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.444270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4964488-3b72-4b3b-ab97-c546d0704632 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.452010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.453551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.489698 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.490638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.490811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.491091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.492300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.493753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.495526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 78/158] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:47.500303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.574892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 81/159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:47.576152 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.580138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.597720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.601136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfab6a-5565-4936-845d-209b80b6094d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.638787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.639455 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.639833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.640112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.679337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307098f-769f-4bce-8c81-11e8a01d80f9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.705888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.707354 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c86ee0-b5cb-4944-bce3-531a00b604fa None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.713923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.714605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.714922 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.715199 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.715969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.717473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.743220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 82/160] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:47 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:47.744275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.820931 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.825895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:47.830924 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 79/161] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:47.836899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501ef-0f72-4e9b-abcb-2d37ab6b7022 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.837199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501ef-0f72-4e9b-abcb-2d37ab6b7022 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.837482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec501ef-0f72-4e9b-abcb-2d37ab6b7022 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.838983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 80/162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:47.840174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0b8-e73c-4b99-a394-fd325dd83676 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.840459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0b8-e73c-4b99-a394-fd325dd83676 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.840735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289e0b8-e73c-4b99-a394-fd325dd83676 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.842110 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 81/163] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:47.846431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e0b8-e73c-4b99-a394-fd325dd83676 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:47.879846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a21b2-860e-49e8-9dc0-068621a3adf4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:47.923949 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:47.924847 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.925133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.925747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.926771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:47.928612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5c11-180b-4567-b25f-a77a611f7b62 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:47.935544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 83/164] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:47.935544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:47.935544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:47.935544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:47.952161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:47.953390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:47.963415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289e0b8-e73c-4b99-a394-fd325dd83676 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.001015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.001895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.002179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.002456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.003695 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:48.005316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5105e-7952-4a77-936e-fe701f53488e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:48.007444 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 82/165] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:47 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:48.008318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.008593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.008868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.027611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:48.028880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:48.043732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 84/166] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:48.044677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.129357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:48.135981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:48.137489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 83/167] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:48.138351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.200114 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb263a6-abc5-4f8b-808a-0a311f8b105c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.248421 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.249018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.249299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.249597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.250450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=a341201fe78a44788ba60279420a0db2) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:48.250822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:48.252299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:48.261719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 85/168] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/role_assignments?user.id=a341201fe78a44788ba60279420a0db2&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:48.262385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.273229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce3509-d227-434f-ae17-a6c124b71c1f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.319733 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.320465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.320750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.321034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.322529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:48.322902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:48.325262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:48.333759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 84/169] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=c648a19d06904216a8c19d1bf459539b => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:48.334654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.434159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5917c-26ab-4cbe-912f-10b79d751c36 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.452701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:48.500743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:48.536086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.537598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.538120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.538601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.544938 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55493db-a32b-4c46-94e9-61c28cfd87b6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.561665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:48.570413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:48.571488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:48.572656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:48.585257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 86/170] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:48.592220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.623914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.625157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.625857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.627295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.643028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:48.655429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:48.656482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:48.657372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:48.659971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 85/171] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:48.666272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.777464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eccbd-37cd-48de-b4b0-15a6bc69eb96 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.784243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d0988-26e4-4caa-b33a-0ecb41d37d22 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:48.802129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:48.826295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.827164 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.827505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.827782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.828619 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:48.828932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:48.830388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:48.840984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 86/172] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:48.848448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.852971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:48.853776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:48.854065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:48.854344 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:48.855154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:48.855466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:48.857826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:48.869306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 87/173] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:48.877061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:48.949630 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:49.006378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476a8f9-973c-4430-8cd1-88874873e7d1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.026710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa6ab0-29c6-45b3-aa56-12a24d6169cd None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.049479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.050305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.050611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.050992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] PATH_INFO: `/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.052296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] RBAC: Authorizing `identity:get_user(user_id=1154fafd1d0b4e98bf95cfa4d6a10d05)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.053758 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.058413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 87/174] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/users/1154fafd1d0b4e98bf95cfa4d6a10d05 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:49.064231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:49.070600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.071536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.071825 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.072138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] PATH_INFO: `/v3/users/80dc438c2f794d349aa3ab63b15e732d` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.073396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=80dc438c2f794d349aa3ab63b15e732d)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.074939 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.081924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 88/175] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:48 2022] GET /identity/v3/users/80dc438c2f794d349aa3ab63b15e732d => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:49.087737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:49.134126 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:49.189555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836fd37-08cf-4b9c-b5e3-ea5d7b13bc4d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.232867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.233565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.233828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.234107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.318617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.320223 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.352675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee88ee-2a64-431d-b66b-771267a4a1a2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.378212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:49.391040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:49.431451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 88/176] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:10:49.436454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:49.457660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.458576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.458888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.459165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.460439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.462189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.464013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 89/177] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:49 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:49.481302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:49.608732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2174de-ccc1-4c3b-adb4-ce4d9a36247e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.653364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.654258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.654565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.655030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] PATH_INFO: `/v3/projects/5243d31983304136a4a3c52199b78e6d` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.659449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] RBAC: Authorizing `identity:get_project(project_id=5243d31983304136a4a3c52199b78e6d)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.660928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.662728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 89/178] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:49 2022] GET /identity/v3/projects/5243d31983304136a4a3c52199b78e6d => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:49.668667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:49.678232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116fdd1-0c6a-4ba2-9617-3ee8b4b8a419 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.715145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.716462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.716948 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.717422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/80dc438c2f794d349aa3ab63b15e732d/roles/06fd2332a4e74db5a4fdaac66ca776f1` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.719678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, user_id=80dc438c2f794d349aa3ab63b15e732d, role_id=06fd2332a4e74db5a4fdaac66ca776f1)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.721484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a558-8a10-4e05-bb5a-f8f805ae6b00 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.724578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:49.742590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 90/179] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:49 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/users/80dc438c2f794d349aa3ab63b15e732d/roles/06fd2332a4e74db5a4fdaac66ca776f1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:10:49.849314 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29094d-9574-48bc-9653-02d0684fd3fd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:49.887092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:49.888195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:49.888690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:49.889175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:49.890258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=5243d31983304136a4a3c52199b78e6d, user.id=1154fafd1d0b4e98bf95cfa4d6a10d05) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:49.890840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:49.892598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc22914-595b-4bb4-a591-880ca8c36a6c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:49.899638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 90/180] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:49 2022] GET /identity/v3/role_assignments?user.id=1154fafd1d0b4e98bf95cfa4d6a10d05&scope.project.id=5243d31983304136a4a3c52199b78e6d&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:50.702188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d993-815a-47f4-bd57-75ca196ca7cd None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:50.703285 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d993-815a-47f4-bd57-75ca196ca7cd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:50.703822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d993-815a-47f4-bd57-75ca196ca7cd None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:50.705719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 91/181] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:50.710955 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:50.711379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:50.711574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:50.729689 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:50.730931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:50.795198 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792979-1589-4a12-80ad-ada784174fbf None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:50.795491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792979-1589-4a12-80ad-ada784174fbf None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:50.795685 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1792979-1589-4a12-80ad-ada784174fbf None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:50.797355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 92/182] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:50.803782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:50.804196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:50.804603 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:50.817246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 91/183] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:50.825514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:50.827077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:50.837015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:50.854245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:50.869645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:50.907328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 93/184] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:50.931429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:50.945934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e8bfe-2191-4ca4-b7fe-8a44a0e6f887 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:50.983107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:50.983924 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:50.984211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:50.984489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:50.995102 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d622bfda-cce4-4f47-a8e4-22cdc64a74d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:51.002932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:51.003997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:51.004888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 92/185] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:51.010270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aad76-9a1b-4c46-9d08-8db36201f2f3 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.010565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aad76-9a1b-4c46-9d08-8db36201f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.010888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4aad76-9a1b-4c46-9d08-8db36201f2f3 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.014838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 93/186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:51.014838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aad76-9a1b-4c46-9d08-8db36201f2f3 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.056277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7c27d-44a9-4c1c-90aa-62aec804290f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.093443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.097717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.099167 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.099417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.099717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.101163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.103275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88215263-fc25-4cf7-af72-ed83ac4aeb5e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.110540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 94/187] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:51.110540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.110540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.110540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.126862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4aad76-9a1b-4c46-9d08-8db36201f2f3 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.127204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:51.128381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:51.165191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.171876 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.172569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.172858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.173133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.173918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:51.174232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.175760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.188128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 94/188] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:51.189066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.218718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 95/189] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:51.218718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.301156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a52150-32cf-462b-807a-e42f58839ae5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.333349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75088c0f-045a-4408-8bff-8c7aa819f4fd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.335607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.336292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.336575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.336852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.337579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.339107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.347070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.363939 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 95/190] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:51 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:51.372171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.373133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.373416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.373689 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.376345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.390872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.392891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.398749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 96/191] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:51.402463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.444309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.514332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63334e4-d068-4043-af54-aef747f091a2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.545100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445385aa-5b73-488e-ae28-f9ae4b6e2e26 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.563674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.565068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.565850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.566369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.582080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:51.589446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.590072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.590337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.590609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:51.591942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:51.592952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:51.593854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:51.596131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 96/192] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:51.604841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.669394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.676239 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.678053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.711179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.736159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde0e98-005a-450b-b491-04c4348af9be None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.779259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.779950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.780241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.780524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.781312 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:51.781625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.783058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.792018 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 97/193] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:51.797561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.804677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 97/194] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:10:51.810836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:51.918500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee543f48-b26f-45ef-9bd2-d18088a0da2f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.935527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.944644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524687c4-e829-46a0-8cd8-2d708a516c69 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:51.974387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:51.985766 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.986739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.987032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.987313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.988589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:51.990057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:51.991830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 98/195] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:51.994713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:51.995624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:51.995910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:51.996189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:51.998158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.000969 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:52.002469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:52.004212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 98/196] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:52.015106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.210630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01008-5e4e-44c8-aeb4-0a08eb471b96 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:52.236891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a83c-a7f0-48f6-a313-9578b78cc131 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:52.246303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:52.247011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.247342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.247626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.311578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:52.323756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:52.326358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:52.332116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:52.333026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.333488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.333963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.335051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=e8b4f0f0ee4f419ea72a0a5b590b6427) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:52.335547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:52.337623 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04fd4-71f8-4b8d-b223-cd8d996c9a25 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:52.345947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 99/197] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:51 2022] GET /identity/v3/role_assignments?user.id=e8b4f0f0ee4f419ea72a0a5b590b6427&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:52.347994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0a87-e9df-4a92-90b1-eef420d2dc9b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.348782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0a87-e9df-4a92-90b1-eef420d2dc9b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.349207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d0a87-e9df-4a92-90b1-eef420d2dc9b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.355704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 100/198] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:52.357405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.357698 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.357982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.377277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:52.378360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:52.441222 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:52.442944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 99/199] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:52.448999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.480660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 101/200] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:52.506537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.584798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:52.601944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001fe1-3a21-4281-ba0b-bec79fff4130 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:52.640539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:52.641414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.641696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.641968 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.644701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:52.646164 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:52.650882 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 100/201] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:52 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:52.657804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.773498 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dedb70-a8f6-49bc-b53d-7e83ddc70c4c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:52.774603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b2941-c3d3-458b-8499-f94e911f734e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:52.809981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:52.810657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.810969 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.811246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.812099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=e8b4f0f0ee4f419ea72a0a5b590b6427) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:52.812415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:52.813858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:52.819945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 101/202] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:52 2022] GET /identity/v3/role_assignments?user.id=e8b4f0f0ee4f419ea72a0a5b590b6427&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=c648a19d06904216a8c19d1bf459539b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:52.856464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:52.857314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:52.857608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:52.857887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:52.875483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:52.884006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:52.886546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:52.888664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 102/203] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:52.894907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:52.921080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:53.019669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ee149-4cee-4754-baae-028f09e7ebde None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:53.055196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:53.055811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:53.056093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:53.056441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:53.057225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:53.057532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:53.058962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:53.068808 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 102/204] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:53.074547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:53.138771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:53.220821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a706095-2297-4661-8b59-a8ca70e9cfa9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:53.271700 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:53.273066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:53.273568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:53.274059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] PATH_INFO: `/v3/users/80dc438c2f794d349aa3ab63b15e732d` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:53.275589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] RBAC: Authorizing `identity:get_user(user_id=80dc438c2f794d349aa3ab63b15e732d)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:53.277329 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:53.279655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 103/205] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:53 2022] GET /identity/v3/users/80dc438c2f794d349aa3ab63b15e732d => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:53.286706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:53.423145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:53.457970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69ead-95dd-4c12-acd3-fb9cd40ce0bf None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:53.516620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:53.517298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:53.517593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:53.517875 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:53.622442 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:53.623975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:53.726579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:53.752105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 103/206] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:53.757836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:53.901904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ddb0d-a954-4063-b251-725eb984b56c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:53.924858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:53.953794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:53.955133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:53.955629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:53.956120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:53.963487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:53.965321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c60d52-7a6b-4163-93a4-0f1c9f9f19a9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:53.967387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 104/207] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:53 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:53.973673 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.062726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d5b5-06f1-4be0-afa5-17d24bfa79d6 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.063035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d5b5-06f1-4be0-afa5-17d24bfa79d6 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.063234 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d5b5-06f1-4be0-afa5-17d24bfa79d6 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.064589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 105/208] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:54.069534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.069822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.070101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.087372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:54.088579 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:54.131632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13be6-1481-4815-a678-c665b13cd566 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:54.176411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:54.177447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.177965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.178444 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.181037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb, user.id=80dc438c2f794d349aa3ab63b15e732d) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:54.182670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:54.184393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:54.196238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 104/209] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:53 2022] GET /identity/v3/role_assignments?user.id=80dc438c2f794d349aa3ab63b15e732d&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:54.212386 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 106/210] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:54.248650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.321177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:54.403388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ea3a-cd47-4907-b311-69e07db274ba None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:54.448597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:54.449448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.449739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.450025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.479143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-a04c4dfd-0503-407e-89fa-82c62187d491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:54.487212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:54.488187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:54.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 105/211] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:54.494406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.622110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674b184-3fcf-4cff-99a1-a5253c6d6b96 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:54.637659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:54.647674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f671d-2875-4204-9805-6492510275e2 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.647961 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f671d-2875-4204-9805-6492510275e2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.648250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f671d-2875-4204-9805-6492510275e2 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.649931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 106/212] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:10:54.655314 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.655611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.656000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.661645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:54.662537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.662773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.663060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.664125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:54.664249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:54.665713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:54.674426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:54.674895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 107/213] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:54.676003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:54.680292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.775057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 107/214] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:54.798196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f88e-1781-4060-a119-a7d0ce494c12 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:54.801595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.834850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:54.835170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:54.836179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.837514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.837701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] PATH_INFO: `/v3/users/77edd80544f042d180a66e495654d750` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.857777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] RBAC: Authorizing `identity:get_user(user_id=77edd80544f042d180a66e495654d750)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:54.860114 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:54.863181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 108/215] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:54 2022] GET /identity/v3/users/77edd80544f042d180a66e495654d750 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:54.871748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:54.919984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:54.927461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fac4b-5288-4d4a-bf23-2c6dfab9007b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:54.969422 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:54.970625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:54.971139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:54.971753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:54.973626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:54.975340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:54.978025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 108/216] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:54.983479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.015921 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dc659-ecad-44bc-8ae5-daa9b963d11e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.061417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.063351 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.063822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.064301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.091035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.095548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5db8-cf34-489a-841f-a6c4c99e4a62 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.135955 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.136646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.136933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.137213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.137949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:55.139437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d883b73-9746-471e-986f-92cf77607ec8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:55.148205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:55.149964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:55.164740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 109/217] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:54 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:10:55.176477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835eb1-891a-4c38-ad78-c1f8c440603c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.176667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835eb1-891a-4c38-ad78-c1f8c440603c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.176941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835eb1-891a-4c38-ad78-c1f8c440603c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.182603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 110/218] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:55.184317 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.184608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.184888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.199871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.215796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:55.218292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:55.295117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 109/219] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:10:55.296778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.318348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 111/220] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:55.347679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.433963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67bbe-a90d-40ad-bb7f-43b100ec5359 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.463611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.485178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.486315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.486832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.487264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.488679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:55.489339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8875a-d1e1-49de-a4e9-df0d370a2191 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.490469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:55.492753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 110/221] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:55.498594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.503154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.532231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.533552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.533698 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.534271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.546931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:55.555154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:55.556445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:10:55.557642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:55.559323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 112/222] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:55.565304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.630224 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c129d-f6d4-4445-908f-ff76bdabd86f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.668572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.669248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.669534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.669813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.670676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=77edd80544f042d180a66e495654d750) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:55.671019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:55.672471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01477d4c-b3c2-4f44-b04e-f26499f23b89 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:55.678909 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 111/223] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/role_assignments?user.id=77edd80544f042d180a66e495654d750&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:55.680663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244e2a-71b1-42dc-bee1-b2e20ce730d9 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.681288 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244e2a-71b1-42dc-bee1-b2e20ce730d9 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.681783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58244e2a-71b1-42dc-bee1-b2e20ce730d9 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.687842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 112/224] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:55.690223 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.690749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.691312 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.699522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375425d-787f-4582-a14f-6d524a292531 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:55.712383 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:55.714008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:55.745730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:55.746900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:55.747426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:55.747919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:55.748945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:55.749541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:55.751300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:55.761157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 113/225] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:55.771923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.784390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.795268 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:55.822879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 113/226] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:55.882069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:55.972343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fa406-ed72-4927-98e7-5918f0b09ebc None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.018457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.019392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.020035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.020321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.021722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.023372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.024938 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0028d-ffec-47e4-84d1-8cc62294f899 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.025539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 114/227] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:56.031404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.101164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.102008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.102378 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.102664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.123070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:56.132989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:56.134038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:56.135117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 114/228] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:10:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:56.151076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.163724 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:56.190512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ea343-124d-425b-8d05-88700dbb4de3 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.227966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.229361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.229878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.230412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.231904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.233773 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.235811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 115/229] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:56 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:56.242458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.268885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:56.324459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dc17-8132-404b-ba25-e041d8a7283d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.363327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.364425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.364920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.365416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.373211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:56.373211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.373211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.386846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 115/230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:10:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:56.392908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.463815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4c46-00ca-4642-a62f-ba39deb79448 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.532547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae403d8-8fcf-4827-bd1f-6f090ec7d785 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.551398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:56.562880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.563805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.564107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.564430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/e8b4f0f0ee4f419ea72a0a5b590b6427/roles/3d4222f61d774512b154900643156352` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.566422 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, user_id=e8b4f0f0ee4f419ea72a0a5b590b6427, role_id=3d4222f61d774512b154900643156352)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.569761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.578940 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.580230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.580678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.581141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.585516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.589409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.594930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 116/231] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:56 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/e8b4f0f0ee4f419ea72a0a5b590b6427/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:10:56.595442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 116/232] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:56 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:56.604321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.612025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:56.738427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd9526-d22d-4971-a52d-ea51ee2daeb8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.776573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.777807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.778292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.778789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.780223 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.781942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a400ba3-f8f9-4e11-8ed0-64fbb15513cf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.783993 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 117/233] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:56 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:56.789927 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:56.919224 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1185d-2a46-4353-9471-9276c19a05cb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:56.960620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:56.961545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:56.961823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:56.962101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/e8b4f0f0ee4f419ea72a0a5b590b6427/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:56.964470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, user_id=e8b4f0f0ee4f419ea72a0a5b590b6427, role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:56.965929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb92d7-9515-471e-aa49-0923d7991644 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:56.993127 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 117/234] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:56 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/e8b4f0f0ee4f419ea72a0a5b590b6427/roles/c648a19d06904216a8c19d1bf459539b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:10:57.880864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b699a-e64f-4b59-a71a-356bc04a4ab3 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:57.881891 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b699a-e64f-4b59-a71a-356bc04a4ab3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:57.882404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b699a-e64f-4b59-a71a-356bc04a4ab3 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:57.884497 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 118/235] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:57.890436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:57.890942 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:57.891031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:57.913007 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:57.914206 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:57.948810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787f45-83dd-4add-bad4-b4fae1cdd741 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:57.949472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787f45-83dd-4add-bad4-b4fae1cdd741 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:57.949953 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b787f45-83dd-4add-bad4-b4fae1cdd741 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:57.951869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 119/236] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:57.956963 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:57.957254 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:57.957528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:57.970269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:57.978878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:57.981064 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:58.015139 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 118/237] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:58.038728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.056549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.066795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 120/238] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:58.089644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.146580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca170dea-f3b5-4111-a497-644a142783e4 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.184252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.185063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.185347 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.185622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.196967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:58.199676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f54b2-6b4f-42d5-9226-3968c498dd97 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:58.205069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:58.206062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:10:58.207490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:10:58.210854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 119/239] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:10:58.212794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.243878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.245200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.245694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.247580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.249119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:58.251804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:58.256440 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.257626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 121/240] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:58.265839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.329856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040cb81-f718-4772-a28c-e2d9c14449b0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.341379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.371506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.372565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.373008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.373470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.374454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:58.375034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:58.376786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:58.382663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d87422-b453-4192-80f3-3ee4ae2cb401 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.387619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 120/241] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:58.393341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.420855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.421835 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.421951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.422308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.423170 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:58.424802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5416666-ac0a-4513-b2c0-946c71263f85 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:58.461936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 122/242] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:10:58 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:10:58.516697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.521212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d593b2-d8ee-4a0c-9cce-b851609fe7ef None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.560805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b7d2e-780b-4c6d-9435-b7973270d150 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.561098 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b7d2e-780b-4c6d-9435-b7973270d150 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.561381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b7d2e-780b-4c6d-9435-b7973270d150 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.566739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 123/243] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:58.568338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.568743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.569038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.569260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.569359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.569548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.569828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] PATH_INFO: `/v3/users/c88894c2a3ee4b879730f512da732c22` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.594824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:58.596079 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:58.600293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] RBAC: Authorizing `identity:get_user(user_id=c88894c2a3ee4b879730f512da732c22)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:58.601881 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:58.604894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 121/244] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/users/c88894c2a3ee4b879730f512da732c22 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:58.611411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.725856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 124/245] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:10:58.753685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:58.780370 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc10f0-d65e-46ac-9b94-70c19368d37f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.820162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.828381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.829418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.829920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.830290 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.859296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:58.876461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf2862-6be7-455c-baf1-9caf9fb519a2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:58.911060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:58.912702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:58.919210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:58.920688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:58.921190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:58.921631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:58.940017 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:10:58.951391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:10:58.952577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:10:58.953628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:10:58.956995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 125/246] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:10:58.962935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.043990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 122/247] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:10:59.049953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.098122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3957-b2f3-4bc4-b154-8bf7bfac2db8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.117375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:59.126267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:59.148163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.149258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.149754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.150271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.151277 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:59.151786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.153937 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.165768 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 126/248] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:59.171991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.192188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e304b96-970a-49a6-b2a0-3dc53003ba27 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.234551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.235739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.236024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.236301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.237770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.239278 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.241307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 123/249] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:59 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:59.247090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.299877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204d5ee-5253-4d33-aa4d-306c2efd883f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.343131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.344694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.345192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.346181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] PATH_INFO: `/v3/users/77edd80544f042d180a66e495654d750` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.347958 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] RBAC: Authorizing `identity:get_user(user_id=77edd80544f042d180a66e495654d750)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.349769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.351802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 127/250] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:10:59 2022] GET /identity/v3/users/77edd80544f042d180a66e495654d750 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:59.368563 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.375654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2caeeb-6b5b-4ecd-b91b-30ae438147f7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.401610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:59.414474 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.415435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.416028 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.416447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.417489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=c88894c2a3ee4b879730f512da732c22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:10:59.417952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.419665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f27ad-7a33-4cb3-b56e-02ad32f821e5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.426475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 124/251] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:10:59 2022] GET /identity/v3/role_assignments?user.id=c88894c2a3ee4b879730f512da732c22&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:10:59.486171 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:59.564096 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c98d-d38a-4df4-9622-96596f3bd62a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.605004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1fc0-3763-43e9-8fda-a4d73f0a152d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.605743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1fc0-3763-43e9-8fda-a4d73f0a152d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.606313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1fc0-3763-43e9-8fda-a4d73f0a152d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.608188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 125/252] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:10:59.614673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.615010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.615261 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.616139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.617481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.618011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.618537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.620448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.622190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.624868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 128/253] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:10:59 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:10:59.631366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.659336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:10:59.660567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:10:59.828062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 126/254] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:10:59.845901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3991cf-a11b-4fdf-93cf-30fd69050c78 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:10:59.867069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:10:59.869422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:10:59.926297 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:10:59.927250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:10:59.927538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:10:59.927815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/77edd80544f042d180a66e495654d750/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:10:59.930524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, user_id=77edd80544f042d180a66e495654d750, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:10:59.933130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:10:59.976080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 129/255] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:10:59 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/77edd80544f042d180a66e495654d750/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:00.051707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7621-15e2-4282-81ae-c8c519e5287a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:00.083153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:00.105635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:00.106465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.106767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.107044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.122784 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:00.135131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:00.136189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:00.137065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 127/256] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:00.142418 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:00.281674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89757e76-3ea6-4636-9cf1-1a04ce50be1a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:00.317782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:00.318481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.318790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.319072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.319848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:00.320157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:00.321600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:00.331623 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 130/257] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:00.337465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:00.486596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04696233-de39-4962-95a2-23dce7b51a97 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:00.533861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:00.534778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.535066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.535343 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.536588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:00.538067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02633baf-afb5-4ded-b951-f6b7068b3511 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:00.540070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 128/258] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:00 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:00.545332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:00.593346 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c73f-1cd1-49f0-af07-f1422fa12224 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.593641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c73f-1cd1-49f0-af07-f1422fa12224 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.593839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61c73f-1cd1-49f0-af07-f1422fa12224 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.595516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 129/259] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:00.600947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.601241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.601526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.606928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:00.635182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:00.636392 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:00.753284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:00.766996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288e57-5da2-48d1-97f9-25eaa8170d59 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:00.818560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 130/260] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:00.836894 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:00.837586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:00.837879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:00.838160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:00.853836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.009624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:01.011159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:01.078833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af59a-ee39-46ab-91a8-85faf6332a5d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:01.082963 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:01.171423 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:01.172281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.172573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.172854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.203783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:01.219564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:01.220659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:01.221527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 131/261] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:01.226751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.246371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 131/262] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:01.253233 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.313662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:01.434803 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5f320-1ac9-48c5-9be1-3cb56e844168 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:01.522089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158c2df-3b4d-4ee2-8b8a-5e768cb5d263 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:01.523409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:01.524113 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.524404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.524676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.525518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:01.525833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:01.528555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:01.543213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 132/263] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:01.548555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.586744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:01.588176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.588692 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.589188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.590732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:01.592515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:01.596942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 132/264] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:01 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:01.601173 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.606239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:01.756923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:01.763200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c472013-5ffc-46d0-9880-9ae73e0bf962 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:01.823142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e69205-c849-430b-ba90-2a8edc21b6e2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:01.842927 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:01.844207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.845974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.846458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] PATH_INFO: `/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.848918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] RBAC: Authorizing `identity:get_user(user_id=e8b4f0f0ee4f419ea72a0a5b590b6427)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:01.850789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:01.854072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 133/265] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:01 2022] GET /identity/v3/users/e8b4f0f0ee4f419ea72a0a5b590b6427 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:01.859382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:01.907595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:01.910439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.910957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.912337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.913423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=e8b4f0f0ee4f419ea72a0a5b590b6427) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:01.915299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:01.918543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ec00b-261f-4b77-97ec-8c91ff23a7a8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:01.927967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 133/266] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:01 2022] GET /identity/v3/role_assignments?user.id=e8b4f0f0ee4f419ea72a0a5b590b6427&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:01.932864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d18f-88df-41ff-9069-fcf0a49dc757 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.934178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d18f-88df-41ff-9069-fcf0a49dc757 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.934868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d18f-88df-41ff-9069-fcf0a49dc757 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.938986 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 134/267] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:01.944562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:01.945153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:01.945633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:01.976392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:01.978178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:02.087620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d1e39-34ba-4278-9c33-5177ac257f72 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.101298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.116406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 135/268] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:02.140658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.148451 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.154722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.155472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.155892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.239488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.299830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.303004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9351d0-2a14-4dfa-bd85-b583c5dd842d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.356929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d5fbf-0baa-4e7c-a8f1-cfa16d3512fc None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.403577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.404459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.404753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.405035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.419499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9a59b8b6-2bdf-492d-9887-699ceb538e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:02.430587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:02.431964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:02.433061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 136/269] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:02.433821 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99196b1-3459-485a-b679-21f6f39277d7 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.433926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99196b1-3459-485a-b679-21f6f39277d7 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.434265 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99196b1-3459-485a-b679-21f6f39277d7 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.436121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 137/270] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:02.438775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99196b1-3459-485a-b679-21f6f39277d7 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.447155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 134/271] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:02.449458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.449458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.449458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.472742 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:02.472742 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:02.527179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.549068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.559934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 135/272] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:02.561235 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.587105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99196b1-3459-485a-b679-21f6f39277d7 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.630654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.632001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.632951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.633586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.634846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:02.635560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.637553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.649092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 138/273] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:02.649774 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.692636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382520e-dd67-4c99-9e15-c579dcfe8686 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.729598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.730485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.730806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.731111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.732335 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.733816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.735599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 136/274] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:02.736374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.764807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f104-552c-457e-bf93-d180a2d245e1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.782979 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.801430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:02.803334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.804138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.804426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.804699 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.806412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.808063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478bfd7-cd6c-4453-9d07-aa1cf9cd5268 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.810004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 139/275] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:02.811263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902988-2dbc-46e4-9ca2-4fb3384a458c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.811552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902988-2dbc-46e4-9ca2-4fb3384a458c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.811830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4902988-2dbc-46e4-9ca2-4fb3384a458c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.817191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 140/276] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:02.818094 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902988-2dbc-46e4-9ca2-4fb3384a458c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.843449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85736c13-9338-47db-be12-3e2e2c296b08 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.882304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.883142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.883424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.883702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] PATH_INFO: `/v3/users/077f64efcfe045b1b2c41f3ff9c2e145` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.897961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] RBAC: Authorizing `identity:get_user(user_id=077f64efcfe045b1b2c41f3ff9c2e145)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.899465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.905830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 137/277] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/users/077f64efcfe045b1b2c41f3ff9c2e145 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:02.905830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:02.932344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4902988-2dbc-46e4-9ca2-4fb3384a458c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:02.968317 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:02.969354 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.969837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.970319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:02.971425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=e8b4f0f0ee4f419ea72a0a5b590b6427) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:02.971957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:02.973925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56f657-7892-48d4-b1f5-bbac12498067 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:02.980078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 141/278] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:02 2022] GET /identity/v3/role_assignments?user.id=e8b4f0f0ee4f419ea72a0a5b590b6427&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=c648a19d06904216a8c19d1bf459539b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:02.981445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:02.981799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:02.982141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.012726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:03.014377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:03.015800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4b6dc-c2eb-4ea2-a92f-9cbae43c4a43 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.050491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.069129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.070216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.070718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.071576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.073226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:03.075479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:03.077942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.109737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 142/279] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:03.116159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.116882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 138/280] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:02 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:03.168602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.282639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbc2de-363f-46fb-93c9-a4753a81f0fa None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.313024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4c631-a39e-4304-a0f0-110b74eb2375 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.356439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.357646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.358211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.358761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.378254 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.379525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:03.384281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.384593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.384883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.385775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, user.id=077f64efcfe045b1b2c41f3ff9c2e145, scope.system=all) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:03.386100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-259197f4-96c1-435d-95f2-74e2aa5735de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:03.387521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:03.388471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:03.389358 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 139/281] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:03.390650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88902fd-0ace-4b79-ae1a-370626c564a5 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.390960 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88902fd-0ace-4b79-ae1a-370626c564a5 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.391238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88902fd-0ace-4b79-ae1a-370626c564a5 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.392795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 140/282] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:03.396516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:03.402490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.402996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.402996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.413733 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 143/283] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/role_assignments?user.id=077f64efcfe045b1b2c41f3ff9c2e145&scope.system=all&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:03.414288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.427322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:03.428747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:03.466510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.477790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.523062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 141/284] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:03.550717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.554753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081349ab-4d11-48bf-8986-405c9a246202 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.625759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.626462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.628445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.628761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.630570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:03.631718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:03.633173 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:03.646263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 144/285] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:03.652947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.712274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e70b8-47ee-4084-aa11-795ed857f4e2 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.764040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.770710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.772296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.772797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.784754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:03.786351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9ad4-62ee-4f62-8136-a50940d8a7ac None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:03.794759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:03.795776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:03.796668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:03.799807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 142/286] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:03.806734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.808057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.855300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:03.896604 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:03.897507 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:03.897791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:03.898073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] PATH_INFO: `/v3/users/c88894c2a3ee4b879730f512da732c22` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:03.900135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] RBAC: Authorizing `identity:get_user(user_id=c88894c2a3ee4b879730f512da732c22)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:03.901600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:03.908116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 145/287] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/users/c88894c2a3ee4b879730f512da732c22 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:03.918382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:03.975241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d3137-06c9-4ae2-ab67-cdcbd5ea5c1e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.047985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.048674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.048961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.049237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.050018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:04.050328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.051762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.071388 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 143/288] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:04.076946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:04.095196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846fb85-8051-4a10-b23a-f8e5411b3bda None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.137732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.138615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.139034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.139321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.140655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.142218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.148872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 146/289] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:03 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:04.150393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:04.176296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:04.186628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e3ab-a75c-4be5-a9aa-bbdd442cfbb6 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.199376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:04.235286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.236101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.236386 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.236662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] PATH_INFO: `/v3/users/77edd80544f042d180a66e495654d750` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.238197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] RBAC: Authorizing `identity:get_user(user_id=77edd80544f042d180a66e495654d750)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.239798 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.241870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 144/290] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:04 2022] GET /identity/v3/users/77edd80544f042d180a66e495654d750 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:04.247390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:04.262607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e072e-78e6-4831-8337-8d6617caa6a5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.299526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.300950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.301530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.302033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/c88894c2a3ee4b879730f512da732c22/roles/06fd2332a4e74db5a4fdaac66ca776f1` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.304382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, user_id=c88894c2a3ee4b879730f512da732c22, role_id=06fd2332a4e74db5a4fdaac66ca776f1)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.306394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.350775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 147/291] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:04 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/users/c88894c2a3ee4b879730f512da732c22/roles/06fd2332a4e74db5a4fdaac66ca776f1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:04.367170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74436b-f8de-4bc9-a27f-7d05f912df4e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.405012 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.405685 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.405969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.406241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.438255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:04.484401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.485973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.625828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 145/292] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:04.631614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:04.743493 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c5c4-aad7-4bf0-a03b-cdca0a235362 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.745358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:04.785058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.785952 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.786239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.786520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.787785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.789263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d01925-6ca1-45d8-bf44-b04980627c7f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:04.791550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 148/293] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:04 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:04.797502 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:04.896489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:04.950496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0afb16-79ab-40d8-aa5a-9b4cd5ac82b0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:04.990116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:04.991241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:04.991737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:04.992243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:04.993320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=77edd80544f042d180a66e495654d750) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:04.993970 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:04.995699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd131b4e-0510-41d5-9af2-2e6d7039fe1c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:05.007249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 146/294] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:04 2022] GET /identity/v3/role_assignments?user.id=77edd80544f042d180a66e495654d750&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:06.033130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fb65-71be-4af6-8247-6bd93e10b624 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.033670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fb65-71be-4af6-8247-6bd93e10b624 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.033670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258fb65-71be-4af6-8247-6bd93e10b624 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.034164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4918-67b6-447e-878e-dad628665391 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.034557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4918-67b6-447e-878e-dad628665391 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.034786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4918-67b6-447e-878e-dad628665391 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.035489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 149/295] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:06.036177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 147/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:06.041462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.041749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.042165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.043550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.043843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.044125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.061054 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:06.061271 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:06.062336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:06.062910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:06.136680 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 150/297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:06.143829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 148/298] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:06.160849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.166499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.235183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.281061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.286069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d908d-4fa6-40df-98e3-40a1a3dd72cd None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.288466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3b251-fd35-4ee0-a9e3-f38d2264f834 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.326641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.327504 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.327790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.328064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.329224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.329372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:06.330305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.330762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.330876 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114872-b928-478e-92a8-57449ba84195 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:06.331284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.332416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 149/299] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:06.333591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595997-5e8d-4e24-99ff-067be51c0f06 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.333875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595997-5e8d-4e24-99ff-067be51c0f06 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.334151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595997-5e8d-4e24-99ff-067be51c0f06 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.335614 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 150/300] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:06.339658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595997-5e8d-4e24-99ff-067be51c0f06 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.346560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d6442e51-1778-41e5-b315-39c77b2057c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:06.355167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:06.356160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:06.357035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 151/301] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:06.357756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.358448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.358448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.375825 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:06.376940 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:06.450840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 152/302] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:06.451260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595997-5e8d-4e24-99ff-067be51c0f06 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.452281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.480168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.495149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.495858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.496145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.496416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] PATH_INFO: `/v3/groups` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.497121 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:06.498572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:06.517663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 151/303] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 20:11:06 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:06.519596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.581606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.594396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a9073-e762-4d16-a2f1-75634135d15b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.639682 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.640834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.641391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.642017 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.643062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] RBAC: Adding query filter params (name=reader) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:06.643583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:06.645226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:06.653374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbc63e-8214-4bdf-bd59-3a1d881d30c7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.655247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 153/304] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:06.661270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.700512 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.701651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.701936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.702211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.718484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:06.729905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:06.731046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:06.731978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:06.734042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 152/305] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:06.737894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.790437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6a89b-9bd6-47a8-ae63-a6cceb23117e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.794339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.842982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.843787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.844538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.844826 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] PATH_INFO: `/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.864380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] RBAC: Authorizing `identity:get_user(user_id=5435d0b1be6c424bbe1e97a1e332cf5a)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:06.866791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:06.868546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b15a8-434f-429f-8705-13be6ac7d864 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:06.868893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 154/306] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:06.875671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.890882 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:06.908502 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:06.909189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.909474 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.909749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.910508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:06.910900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:06.912337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e73a-8940-4c92-b539-4be18e90374c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:06.920601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 153/307] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:06.921857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca8ad-31e4-4b0b-b98e-bfebf8323a82 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:06.922143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca8ad-31e4-4b0b-b98e-bfebf8323a82 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:06.922420 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca8ad-31e4-4b0b-b98e-bfebf8323a82 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:06.923957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 154/308] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:06.928346 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca8ad-31e4-4b0b-b98e-bfebf8323a82 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:06.995853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053b4e8-ca0c-407e-b02a-bd864a7ffe05 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.032380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca8ad-31e4-4b0b-b98e-bfebf8323a82 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.034096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:07.034703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.035967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.036255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.036648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.037831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, user.id=5435d0b1be6c424bbe1e97a1e332cf5a, scope.system=all) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:07.038146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.039644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d4040-1867-4830-bddc-2a4649b166d7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:07.045956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 155/309] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/role_assignments?user.id=5435d0b1be6c424bbe1e97a1e332cf5a&scope.system=all&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:07.047506 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.047797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.048077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.073453 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:07.075462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:07.080792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.082434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.083033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.083523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] PATH_INFO: `/v3/users/077f64efcfe045b1b2c41f3ff9c2e145` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.085161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] RBAC: Authorizing `identity:get_user(user_id=077f64efcfe045b1b2c41f3ff9c2e145)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.087036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:07.089220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 155/310] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:06 2022] GET /identity/v3/users/077f64efcfe045b1b2c41f3ff9c2e145 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:07.095211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:07.171060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 156/311] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:07.195948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:07.199348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:07.238086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb2351-dd53-490e-9c75-3b48b8a913ff None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.276496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.277387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.277675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.277975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] PATH_INFO: `/v3/system/users/077f64efcfe045b1b2c41f3ff9c2e145/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.279495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=077f64efcfe045b1b2c41f3ff9c2e145, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.280886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:07.298713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 156/312] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 20:11:07 2022] PUT /identity/v3/system/users/077f64efcfe045b1b2c41f3ff9c2e145/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:07.334006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365e899-0bc2-4596-b0b2-4acb009bc8d0 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.375270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.376000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.376282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.376554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.389319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:07.397599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:07.398654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:07.399582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 157/313] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:07.406473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:07.450943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:07.531068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5528c2b-ab20-4792-98ad-1c29697d5526 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.566223 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.566933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.567217 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.567556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.568330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:07.568635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.570034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:07.579391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 157/314] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:07.584631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:07.649009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:07.689354 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741d299-3be3-40dd-8013-abe809624482 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.724469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.725368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.725656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.725949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] PATH_INFO: `/v3/users/c88894c2a3ee4b879730f512da732c22` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.727201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] RBAC: Authorizing `identity:get_user(user_id=c88894c2a3ee4b879730f512da732c22)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.728845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:07.730850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 158/315] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:07 2022] GET /identity/v3/users/c88894c2a3ee4b879730f512da732c22 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:07.736529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:07.844794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:07.853381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58749db1-949c-4155-85be-97ecce5a53d3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:07.889631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:07.890671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:07.891177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:07.891638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:07.965233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:07.967066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:08.063361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:08.071486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 158/316] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:08.078291 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:08.188654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75fb78-4487-4253-bd45-cd897200b6be None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:08.221199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:08.227056 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:08.228112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:08.228458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:08.229124 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:08.230484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:08.232240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e644675-fab8-461f-bd3b-9faee50a2c7e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:08.234868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 159/317] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:08 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:08.240891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:08.346430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2ef51-53d1-40d2-9689-63da57f632c2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:08.382718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:08.383411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:08.383698 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:08.383978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:08.384910 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, scope.project.id=f4ec857a65db46b688a3ebffadf38a09, user.id=c88894c2a3ee4b879730f512da732c22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:08.385229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:08.386715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8493d-65eb-4753-bd40-17350f2117f9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:08.393644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 159/318] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:08 2022] GET /identity/v3/role_assignments?user.id=c88894c2a3ee4b879730f512da732c22&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:08.884710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252151-4b51-4699-8e87-4ea029d7f8b4 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:08.885111 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252151-4b51-4699-8e87-4ea029d7f8b4 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:08.885243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c252151-4b51-4699-8e87-4ea029d7f8b4 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:08.886876 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 160/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:08.892229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:08.892498 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:08.892804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:08.909992 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:08.911229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:08.970588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:08.983559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 160/320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:09.005914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252151-4b51-4699-8e87-4ea029d7f8b4 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.111333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c252151-4b51-4699-8e87-4ea029d7f8b4 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:09.145597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:09.146323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.146608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.146914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.148114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:09.149580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886db9-cfa3-4958-88e1-b457199f1124 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:09.151456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 161/321] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:09.157179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.263429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe0b56-369c-40e7-bbde-56c4add4a590 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:09.297575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:09.298257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.298597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.298874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] PATH_INFO: `/v3/groups` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.299654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:09.301070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61cd3b-e37e-4f5c-a08b-ab5e9ead7199 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:09.317897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 161/322] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 20:11:09 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:09.400572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4eb1-6074-4aa0-ac04-bdca694b6d1e None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.400771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4eb1-6074-4aa0-ac04-bdca694b6d1e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.401000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4eb1-6074-4aa0-ac04-bdca694b6d1e None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.402711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 162/323] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:09.408645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace7ba-a61b-4f42-a820-9119a50a68fd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.409009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace7ba-a61b-4f42-a820-9119a50a68fd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.409198 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace7ba-a61b-4f42-a820-9119a50a68fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.428819 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-2aace7ba-a61b-4f42-a820-9119a50a68fd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:09.430087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2aace7ba-a61b-4f42-a820-9119a50a68fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:09.489605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:09.518727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 162/324] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:09.540621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4eb1-6074-4aa0-ac04-bdca694b6d1e None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.606631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680741d-5e57-49a2-bab2-48fb4a27615a None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.607003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680741d-5e57-49a2-bab2-48fb4a27615a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.607278 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680741d-5e57-49a2-bab2-48fb4a27615a None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.609895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 163/325] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:09.616147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960adf-5437-4978-b275-5b2415698569 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.616428 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960adf-5437-4978-b275-5b2415698569 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.616727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960adf-5437-4978-b275-5b2415698569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.618198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:09.636376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-80960adf-5437-4978-b275-5b2415698569 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:09.637578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-80960adf-5437-4978-b275-5b2415698569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:09.658427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4eb1-6074-4aa0-ac04-bdca694b6d1e None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:09.696059 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:09.697253 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.697683 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.698123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.708921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:09.717877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:09.719027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:09.719913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 163/326] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:09.726920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.728797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 164/327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:09.753823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960adf-5437-4978-b275-5b2415698569 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.867038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63148d-60e5-4b3a-b910-f6e37803bca5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:09.892904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960adf-5437-4978-b275-5b2415698569 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:09.903446 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:09.910057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:09.911880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:09.912583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.912870 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.913375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.914069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] RBAC: Adding query filter params (name=reader) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:09.914303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:09.916121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:09.928106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 164/328] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:09.934063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:09.938981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:09.939882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:09.940234 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:09.940580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:09.956384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:09.965141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:09.966201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:09.967120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 165/329] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:09.972016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:10.058092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d535a0-04be-44a8-befc-0f50800c978c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:10.084566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4014f12-410d-4876-ae58-ffd487b88719 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:10.096015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:10.096977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:10.097437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:10.097721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] PATH_INFO: `/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:10.099712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] RBAC: Authorizing `identity:get_user(user_id=5435d0b1be6c424bbe1e97a1e332cf5a)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:10.101610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:10.104083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 165/330] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:10.109465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:10.124169 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:10.125181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:10.125678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:10.126165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:10.127203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:10.127723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:10.129323 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:10.138919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 166/331] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:10.144318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:10.176062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:10.187857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:10.235050 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91399b0c-5d28-4462-ac07-759b1e4663a0 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:10.272911 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:10.273399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128e1e1-20ff-42d5-8a32-c78510db9113 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:10.274815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:10.275350 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:10.275855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] PATH_INFO: `/v3/system/users/5435d0b1be6c424bbe1e97a1e332cf5a/roles/06fd2332a4e74db5a4fdaac66ca776f1` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:10.277645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5435d0b1be6c424bbe1e97a1e332cf5a, role_id=06fd2332a4e74db5a4fdaac66ca776f1)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:10.279283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:10.293260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 166/332] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 20:11:10 2022] PUT /identity/v3/system/users/5435d0b1be6c424bbe1e97a1e332cf5a/roles/06fd2332a4e74db5a4fdaac66ca776f1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:10.313578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:10.314482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:10.314814 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:10.315068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] PATH_INFO: `/v3/users/077f64efcfe045b1b2c41f3ff9c2e145` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:10.316355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] RBAC: Authorizing `identity:get_user(user_id=077f64efcfe045b1b2c41f3ff9c2e145)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:10.317848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50157b-fed3-47b2-bf4d-ff3fe5d4cd72 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:10.320041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 167/333] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:10 2022] GET /identity/v3/users/077f64efcfe045b1b2c41f3ff9c2e145 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:10.325701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:10.442841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d81bd-0c20-4eae-b71b-9aef43ec2cc1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:10.480086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:10.492553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:10.493756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:10.494200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:10.494731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:10.495806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] RBAC: Adding query filter params (role.id=8f8bd3a52aba4305935aa947f1f725ca, user.id=077f64efcfe045b1b2c41f3ff9c2e145, scope.system=all) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:10.496281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:10.498089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fbeda-cb89-458a-a351-cab43cdd9adc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:10.512772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 167/334] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:11:10 2022] GET /identity/v3/role_assignments?user.id=077f64efcfe045b1b2c41f3ff9c2e145&scope.system=all&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:11.903978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410ecc-2922-4dbf-b8f8-2ec0c1054ad7 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:11.904928 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410ecc-2922-4dbf-b8f8-2ec0c1054ad7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:11.905377 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410ecc-2922-4dbf-b8f8-2ec0c1054ad7 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:11.907277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 168/335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:11.912618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:11.913508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:11.914018 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:11.936314 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:11.937933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:12.026473 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 168/336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:12.073660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60410ecc-2922-4dbf-b8f8-2ec0c1054ad7 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:12.191550 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:12.196207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60410ecc-2922-4dbf-b8f8-2ec0c1054ad7 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:12.243357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:12.244678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:12.245185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:12.245688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:12.261312 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:12.275119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:12.276236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:12.277190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:12.280132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 169/337] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:12.285568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:12.402226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcdb35-4c75-4d26-b711-6c73a609d31f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:12.416783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:12.450959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:12.452046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:12.452646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:12.453139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:12.454217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:12.454775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:12.456424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:12.486183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 169/338] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:12.492023 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:12.615874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1f676-c7ca-4212-ac43-4280390502e7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:12.654009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:12.655197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:12.655762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:12.656254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:12.688076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:12.735390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:12.736832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920956c0-dcb1-4fe8-b26a-ea055a89b9a5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:12.857346 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 170/339] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:12.862602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:12.977682 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c1c6-a41c-47df-ae9e-3fa5e6f75714 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:12.978304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c1c6-a41c-47df-ae9e-3fa5e6f75714 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:12.978304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c1c6-a41c-47df-ae9e-3fa5e6f75714 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:12.979967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 171/340] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:12.981501 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8b05c-18a1-4863-9ad6-ebc622681993 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:12.987243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:12.987812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:12.988310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.006433 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:13.008031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:13.028116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.029011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.029303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.029572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.031216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:13.032769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:13.035195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 170/341] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:12 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:13.041099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:13.082604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:13.098612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 172/342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:13.121447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:13.134255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:13.238425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb486a-0944-4e23-956a-9aefd8f1660b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:13.311744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.313110 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.313633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.314127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.325084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:13.326917 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:13.329235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 171/343] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:13 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:13.331616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893640fa-f48d-432c-92c8-6c361ee05db7 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:13.335161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:13.417456 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.418362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.418606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.418887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.452743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:13.466713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:13.467802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:13.468802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 173/344] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:13.470070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:13.494136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861c5b5-b637-4a3c-b266-77c687650b22 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:13.497360 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:13.549266 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:13.550592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.551309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.551596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.551896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.553001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:13.553394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:13.556075 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:13.562741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 172/345] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:13 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:13.612439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb001192-3e93-43b1-bc17-e32d482fd09f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:13.654604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.655323 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.655604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.655886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.656678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:13.656993 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:13.658428 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:13.671235 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 174/346] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:13.677057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:13.805727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce42a-1650-48b1-a88b-374627dd2618 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:13.851130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:13.851816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:13.852103 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:13.852384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:13.903103 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:13.939117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:13.940624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011807a5-d5ef-49fc-90fa-5d5e14c220d3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:14.054230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 173/347] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:14.060595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.175171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06e19d-649d-407d-9259-87c3b52efe45 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.188662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224a7c-dc19-4b6c-a93e-2e30ac185c86 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.189015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224a7c-dc19-4b6c-a93e-2e30ac185c86 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.189227 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224a7c-dc19-4b6c-a93e-2e30ac185c86 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.190631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 174/348] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:14.199812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096566f7-7778-4978-bea2-697825542e70 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.200144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096566f7-7778-4978-bea2-697825542e70 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.200370 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096566f7-7778-4978-bea2-697825542e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.200721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:14.230952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.231841 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.232130 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.232403 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.233632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:14.234594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-096566f7-7778-4978-bea2-697825542e70 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:14.235132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:14.235811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-096566f7-7778-4978-bea2-697825542e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:14.237182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 175/349] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:14.244496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.378343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:14.385286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875006-53e8-4c6c-987e-78293c638903 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.389495 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 175/350] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:14.422480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.423421 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.423711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.424002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.425214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:14.426711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:14.428692 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 176/351] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:14.434728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096566f7-7778-4978-bea2-697825542e70 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.435665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.501492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:14.607865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096566f7-7778-4978-bea2-697825542e70 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.609082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c28abb-d7f4-440e-bf2c-ea752ea81499 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.648828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.649697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.650067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.650392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.651358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:14.654705 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:14.654705 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6891-d6ae-4712-8f87-bf20075ff668 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:14.660425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 176/352] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=c648a19d06904216a8c19d1bf459539b => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:14.661822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1070-43db-4188-8828-bc8272d73441 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.662116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1070-43db-4188-8828-bc8272d73441 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.662394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1070-43db-4188-8828-bc8272d73441 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.664042 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 177/353] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:14.673099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab708-f733-4684-b428-29167ffe6598 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.673492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab708-f733-4684-b428-29167ffe6598 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.673845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab708-f733-4684-b428-29167ffe6598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.690940 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.692248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.692456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-3afab708-f733-4684-b428-29167ffe6598 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:14.692872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.693393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.693890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-3afab708-f733-4684-b428-29167ffe6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:14.716289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:14.725611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:14.726734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:14.727765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:14.735154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 177/354] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:14.737752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.760859 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:14.774379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 178/355] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:14.799428 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab708-f733-4684-b428-29167ffe6598 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.912524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab708-f733-4684-b428-29167ffe6598 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.914523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb60c0-cc83-430e-903e-936d187355d4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:14.929252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:14.952009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.952950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.953311 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.953662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.965122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:14.973167 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:14.974399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2301ca7e-d3b5-4ab3-8457-4491d9e91f74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:14.974829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:14.975996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:14.977088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:14.978212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.978648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.979648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:14.980104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:14.981652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1b4cf-8e10-43f7-8b3a-90ce047c4892 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:14.982869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 179/356] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:14.985325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9e48-8ce8-4fdf-a563-2dd6d90d1d03 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:14.985325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9e48-8ce8-4fdf-a563-2dd6d90d1d03 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:14.985325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9e48-8ce8-4fdf-a563-2dd6d90d1d03 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:14.986595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 180/357] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:14.988316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9e48-8ce8-4fdf-a563-2dd6d90d1d03 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:14.999989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 178/358] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:15.001763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.002334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.002813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.033936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:15.035661 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:15.049397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.108001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9e48-8ce8-4fdf-a563-2dd6d90d1d03 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.156443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.158065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 179/359] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:15.159455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.160355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.161246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.161703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.163146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:15.164957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:15.166897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d497-d900-4c7a-ac66-f33696c6032a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:15.184414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 181/360] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:15.186174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952bd1c-60de-42f3-9eb2-c246eb21824d None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.187423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952bd1c-60de-42f3-9eb2-c246eb21824d None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.188035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952bd1c-60de-42f3-9eb2-c246eb21824d None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.190728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 182/361] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:15.191478 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952bd1c-60de-42f3-9eb2-c246eb21824d None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.297384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.302240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab14475-360a-49ca-86a5-807e4c748603 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.334972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952bd1c-60de-42f3-9eb2-c246eb21824d None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.351135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.351813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.352098 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.352374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.356087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.392828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.393551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.393841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.394123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.457320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:15.458807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:15.478217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:15.480175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb9440-e6b6-4c31-9aad-d1a2fb278a38 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:15.561967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.566325 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 180/362] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:15.567316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.593573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 183/363] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:15.595199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.595710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.596132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.614238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:15.616027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:15.626671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.673404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c353be-7e26-4042-bf6d-0514367d26d4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.694708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 184/364] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:15.696040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.716152 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.718424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.718749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.719025 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.738624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:15.747060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:15.748034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:15.748908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 181/365] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:15.749638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.837567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.853029 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8f39c-0de3-4e1f-8016-6b67d12c95ed None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.889327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.890605 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.891135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.891616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.893030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49fc6-6529-4af4-93e3-01d6b27a67a4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:15.893157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:15.894850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:15.897215 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 185/366] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:15.898216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:15.914318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:15.937463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:15.938405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:15.938718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:15.939018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:15.940505 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:15.942925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:15.944683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 182/367] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:15.945520 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.026541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcdf36-3063-4238-a77d-65a36ead2fd7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.068053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61101f5f-483c-4203-b13c-272c540934dc None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.070485 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.071610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.072115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.072593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.084418 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:16.092656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:16.093642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:16.094519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:16.097086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 186/368] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:16.102084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.103881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.111996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.114854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.115400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.115887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.117508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:16.118035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.120399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.132662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 183/369] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.134407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.192509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.227183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f53111-3a3f-4b54-b151-ec4cc54f1cb0 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.263656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.264032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e255e-41ba-42ea-8af5-fa1f3e2c2188 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.264766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.265140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.265507 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.266850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.268491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.270356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 187/370] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.272185 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.304424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.305723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.306252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.306866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.308303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.310057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.312074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 184/371] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.313155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.378813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.380400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c3072-c922-4514-9d8d-137f1b1c8fd5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.418740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.419519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.419869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.420297 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.421419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:16.421547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.424047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.428021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5281-6dfd-4e26-8104-3e23b4debc7f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.433934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 188/372] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.434877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.441474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.467572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.468886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.469432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.469954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] PATH_INFO: `/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.471604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] RBAC: Authorizing `identity:get_user(user_id=5435d0b1be6c424bbe1e97a1e332cf5a)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.473710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.476059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 185/373] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/users/5435d0b1be6c424bbe1e97a1e332cf5a => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.477142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.553903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8253-d01a-4ca7-bf89-484c8139637b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.591494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.592102 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.592387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.592663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.593551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=f4ec857a65db46b688a3ebffadf38a09) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:16.593816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.594706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2525d7-adaa-4cfb-82f2-b75278ed43c5 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.595293 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.603160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 189/374] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.604408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.627722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.638960 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.640072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.640593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.641083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.642303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=f4ec857a65db46b688a3ebffadf38a09) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:16.642946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.644669 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.651891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 186/375] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=c648a19d06904216a8c19d1bf459539b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.653103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:16.688111 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.729916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191dd56-5265-4ecd-8635-fd19113b29ca None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.769897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.770580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.770968 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.771316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.776848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490947-56b7-4967-9e9e-596a2cf4e7c0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:16.816517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:16.817609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.818126 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.818617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.819837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] RBAC: Adding query filter params (role.id=06fd2332a4e74db5a4fdaac66ca776f1, user.id=5435d0b1be6c424bbe1e97a1e332cf5a, scope.system=all) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:16.820405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.822288 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d9b6-4716-445f-9e6a-a8397e174eb9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.837436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 187/376] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/role_assignments?user.id=5435d0b1be6c424bbe1e97a1e332cf5a&scope.system=all&role.id=06fd2332a4e74db5a4fdaac66ca776f1 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:16.854192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:16.855648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:16.929545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa98f0-bcc1-47bf-91c4-68439c4c4065 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.930230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa98f0-bcc1-47bf-91c4-68439c4c4065 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.930753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa98f0-bcc1-47bf-91c4-68439c4c4065 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.933013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 188/377] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:16.935955 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:16.939584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:16.940611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:16.940611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:16.976036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:16.978002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:16.982280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 190/378] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:16.989974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.056911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:17.094219 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 189/379] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:17.110940 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a33e2-ddba-404e-b1c3-f44a58f7e5ac None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.127228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.153332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.154540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.155025 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.155460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] PATH_INFO: `/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.157295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] RBAC: Authorizing `identity:get_project(project_id=8bf486d74afa4d19ae43e59f70caf3c5)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:17.158994 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:17.161530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 191/380] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:16 2022] GET /identity/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:17.167342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.206877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:17.283708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da557-7c5d-4532-8da1-e2d5829c2ffc None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.301568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05660a-4a49-46f7-a299-4cb3ba62b0dd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.322637 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.323653 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.324035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.324323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] PATH_INFO: `/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.329967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] RBAC: Authorizing `identity:get_group(group_id=32ee5fdf35c2401b83ccb8293ed3f3d4)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:17.331570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:17.333596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 192/381] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:17.339663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.356445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.357291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.357579 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.357854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.373996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:17.386158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:17.387275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:17.388185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 190/382] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:17.398904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.456321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:17.495396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:17.504947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7fee0-45e5-4234-ac1e-daf11af098f8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.556156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c998608-87dc-43c1-bbfb-297b8db55e9d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.578621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.579342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.579634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.579912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.580798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] RBAC: Adding query filter params (group.id=32ee5fdf35c2401b83ccb8293ed3f3d4, role.id=3d4222f61d774512b154900643156352, scope.project.id=8bf486d74afa4d19ae43e59f70caf3c5) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:17.581114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:17.582623 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:17.592445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 193/383] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/role_assignments?group.id=32ee5fdf35c2401b83ccb8293ed3f3d4&scope.project.id=8bf486d74afa4d19ae43e59f70caf3c5&role.id=3d4222f61d774512b154900643156352 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:17.614665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.615454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.615749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.616041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.616816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:17.617123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:17.618592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a06f-ae0c-4ff6-8b96-2ebdcc3bb110 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:17.629087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 191/384] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:17.635905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.807225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f6756-9dec-4074-bf0e-343f407947ea None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:17.825792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cec5-e232-4e0a-acda-3e9195d392ec None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.826464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cec5-e232-4e0a-acda-3e9195d392ec None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.827000 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2cec5-e232-4e0a-acda-3e9195d392ec None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.828963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 192/385] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:17.835567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.836185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.836696 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.858634 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:17.860257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:17.873005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:17.873893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:17.874178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:17.874458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:17.883196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:17.883196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:17.883196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 194/386] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:17.888736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:17.937832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:17.957331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 193/387] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:17.994360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.017320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b9169-7629-4862-bd5d-54312ac1094c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.053805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:18.072436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.073322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.073605 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.073881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.076097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.077573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.079672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 195/388] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:18.084881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.145573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fa6e2-f989-4f12-8e5f-961b0ff2f6e8 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.183014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.183852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.184137 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.184411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.196001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:18.206447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:18.207695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:18.209699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 194/389] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:18.211816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:18.216854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.218412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c6284-f156-4def-99c5-cd70e6dcb485 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.280347 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.281259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.281547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.282037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/groups/6a364a15257642b9bfae23b5eb62c776/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.287502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, group_id=6a364a15257642b9bfae23b5eb62c776, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.317179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 196/390] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:11:18 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/groups/6a364a15257642b9bfae23b5eb62c776/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:11:18.322199 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:18.336360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cad7b9-268a-4f93-b44c-d6710c9ebdbb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.377787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.378861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.379393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.379833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.380783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:18.381259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.382878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.393087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 195/391] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:18.399436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.531668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8e28-3126-408c-aad1-d412ea945911 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.577039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.577941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.578225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.578500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.579804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.581255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.583257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 197/392] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:18 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:18.589528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.717076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6000c5f-6852-4222-9431-f4188933932e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.755804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.757093 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.757602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.758086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.759602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.761447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f804-c129-483b-b116-3500f480d38c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.763782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 196/393] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:18 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:18.770262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:18.799912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:18.886413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d25127-92db-4a5c-a5e6-aed41b63fecf None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:18.923405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:18.924703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:18.925210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:18.925760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/groups/6a364a15257642b9bfae23b5eb62c776/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:18.928335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] RBAC: Authorizing `identity:create_grant(project_id=43b2d39d45e94b0d9647158a36f7f5cb, group_id=6a364a15257642b9bfae23b5eb62c776, role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:18.930038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ca6d9-8a26-4932-a2ea-32ad1f47988a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:18.954635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 198/394] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:11:18 2022] PUT /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb/groups/6a364a15257642b9bfae23b5eb62c776/roles/c648a19d06904216a8c19d1bf459539b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:19.709317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9455c-802d-41db-bd46-a8d5afd37758 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:19.709867 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9455c-802d-41db-bd46-a8d5afd37758 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:19.709867 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9455c-802d-41db-bd46-a8d5afd37758 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:19.711564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 197/395] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:19.728145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:19.728650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:19.728650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:19.751644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:19.752858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:19.766265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa9645-5bc6-4c70-8dd7-d3c29e041144 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:19.766935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa9645-5bc6-4c70-8dd7-d3c29e041144 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:19.767438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa9645-5bc6-4c70-8dd7-d3c29e041144 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:19.769274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 198/396] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:19.775502 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:19.776066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:19.776552 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:19.797914 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:19.801317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:19.817308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:19.846103 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 199/397] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:19.889981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:19.906967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 199/398] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:19.915518 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:19.952097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.081506 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefad27-5d5a-4f57-b497-8501941866df None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.083438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee82f1-417c-4953-bda5-ccfa989c592c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.131471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.132305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.132590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.132867 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.151362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:20.160089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:20.161480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:20.162448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 200/399] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:20.163629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.166716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.166716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.166716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.168380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.184192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:20.195615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:20.212336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:20.214564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:20.216658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 200/400] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:20.223964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.316307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd383c4c-9611-46fa-a7f0-0d77e3990a01 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.383051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:20.383525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.384312 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.384611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.384865 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.385677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:20.385990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:20.388795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:20.408238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 201/401] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:20.416340 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.424117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70599b-63fa-4c63-9887-783679e9fba7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.467384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.468078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.468369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.468648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.469424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:20.469737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:20.472781 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:20.485446 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 201/402] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:20.493690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.547946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:20.609236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc629b-f970-43ae-a33f-b6502c4ec13d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.676204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.677020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.677308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.677587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.679045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:20.680535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:20.682517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 202/403] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:20.689473 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267c9f3-7f43-4103-a9da-96cacb04e8f7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.694852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.757839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.759472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.761776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.762268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.766137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:20.769535 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:20.776346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 202/404] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:20.800150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:20.818178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:20.894937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef7d2-ef73-42df-aeb4-a3e9516d976b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.942235 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:20.943533 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.944049 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.944534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.945976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:20.947808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05341a-17f8-4687-8350-0782931d3e41 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:20.950077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 203/405] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:20.951559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22466e8-f478-45c9-aec6-9198c0829231 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.952068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22466e8-f478-45c9-aec6-9198c0829231 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.952566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22466e8-f478-45c9-aec6-9198c0829231 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.954267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 204/406] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:20.960198 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:20.960790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:20.961282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:20.962770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedf8d8-8040-4389-83be-5a212fe20308 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:20.981704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:20.983291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:20.985662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.005941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.007292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.007900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.008394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.011063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:21.012971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:21.015588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 203/407] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:20 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:21.016620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.082747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 205/408] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:21.083942 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.140609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.163492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c3e0-93c6-4c4f-95c5-d6511ca43296 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.208626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.209786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.210073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.210351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/groups/6a364a15257642b9bfae23b5eb62c776/roles/8f8bd3a52aba4305935aa947f1f725ca` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.212897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, group_id=6a364a15257642b9bfae23b5eb62c776, role_id=8f8bd3a52aba4305935aa947f1f725ca)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:21.214989 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:21.221088 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ccece-8124-4c7a-99ab-dd4ad095f3ff None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.238135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 204/409] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:11:21 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/groups/6a364a15257642b9bfae23b5eb62c776/roles/8f8bd3a52aba4305935aa947f1f725ca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:21.238135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.291599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.293384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.293945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.294702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09/groups/6a364a15257642b9bfae23b5eb62c776/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.300409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec857a65db46b688a3ebffadf38a09, group_id=6a364a15257642b9bfae23b5eb62c776, role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:21.302725 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e799e9-0531-45f6-bb30-bdb146c6bff1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:21.323286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.328537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 206/410] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:11:21 2022] PUT /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09/groups/6a364a15257642b9bfae23b5eb62c776/roles/c648a19d06904216a8c19d1bf459539b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:21.331506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b892c-d1df-4c3e-bcbe-be448c95d49e None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.332362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b892c-d1df-4c3e-bcbe-be448c95d49e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.332721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b892c-d1df-4c3e-bcbe-be448c95d49e None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.338877 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 207/411] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:21.345116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.345405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.345688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.370526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:21.372494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:21.379825 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474a1c4-5e2b-4653-ac92-e80c1419c0ba None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.438021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.439263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.439555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.439886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.449102 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.460948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:21.473840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:21.475061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:21.475971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 205/413] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:21.478835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 208/413] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:21.481476 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.506613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.620376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36920e8-e8e2-4771-9216-fe8b09558c09 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.655712 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5559a-2437-44c8-bc42-22aefd03cccc None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.672469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.673431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.673719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.674288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.675570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:21.675885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:21.677322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:21.686188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.691942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 206/414] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:21.697954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.698888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.699175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.699447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.703709 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.712518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:21.725469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:21.726525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:21.727559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:21.730043 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 209/415] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:21.736853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:21.793346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:21.868564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9d50-dd47-4770-9d84-13264194f213 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.924119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502b88-6ee5-470a-bc35-a2d7f2786736 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:21.935226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:21.936408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:21.936865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:21.937312 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] PATH_INFO: `/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:21.938739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] RBAC: Authorizing `identity:get_group(group_id=32ee5fdf35c2401b83ccb8293ed3f3d4)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:21.942318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:21.944221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 207/416] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:21.950583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.000208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.000835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.001121 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.001400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.002185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] RBAC: Adding query filter params (name=member) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:22.002508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:22.003963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:22.024610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 210/417] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:22.029812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.127585 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbbf01-02ad-464c-aea9-5bcb3881a811 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:22.139849 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:22.179189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:22.192457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.193475 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.193839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.194190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] PATH_INFO: `/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.195633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf486d74afa4d19ae43e59f70caf3c5)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:22.197715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:22.199945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 208/418] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:21 2022] GET /identity/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:22.207247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.250398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cada89-d2f0-48ef-b330-4c17f000cf63 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:22.316583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.317359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.317643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.318038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.362426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45fbe-81aa-40c2-bb2f-bed2fc57cae5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:22.398942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.399919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.400209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.400493 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] PATH_INFO: `/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5/groups/32ee5fdf35c2401b83ccb8293ed3f3d4/roles/3d4222f61d774512b154900643156352` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.401335 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:22.402581 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf486d74afa4d19ae43e59f70caf3c5, group_id=32ee5fdf35c2401b83ccb8293ed3f3d4, role_id=3d4222f61d774512b154900643156352)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:22.402974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:22.403999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0539b1-0dd3-4f2a-bf66-7acc7854aff6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:22.420791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 209/419] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:11:22 2022] PUT /identity/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5/groups/32ee5fdf35c2401b83ccb8293ed3f3d4/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:22.427517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642941-4a59-4de7-b9fd-0dad4793645e None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.427893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642941-4a59-4de7-b9fd-0dad4793645e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.428136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43642941-4a59-4de7-b9fd-0dad4793645e None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.430074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 210/420] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:22.436034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.436543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.436735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.488429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:22.489675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:22.512752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:22.603406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:22.631466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 211/421] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:22.636982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.647809 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 211/422] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:22.685038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.761786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a0df6-076d-4e9d-bb50-a4137e857c40 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:22.800182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.801513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.802016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.802493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.803752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00faae3-4b26-47da-b658-828cd1a5707c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:22.804231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:22.805704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:22.808117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 212/423] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:22 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:22.814844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.843110 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:22.844541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:22.845041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:22.845527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:22.851044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:22.867359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:22.884179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:22.885252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:22.886138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:22.892024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 212/424] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:22.892947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:22.982557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b70cd-86d7-47a2-b04b-a5ec5ea64d71 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.008212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:23.023249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.024528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.024971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.025404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.026826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.028451 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.030640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 213/425] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:22 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:23.038716 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:23.118270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92d797-74dd-415c-b17d-f35c7a152e15 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.179449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.180405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.183058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.183629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.184741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:23.185232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.187296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.201803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 213/426] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:23.204573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:23.209157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:23.233667 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ddd5-6921-44d4-bba5-e8e24945653c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.296588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.298607 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.299280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.300377 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.301621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:23.304695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.306367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.315776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 214/427] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:23 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 611 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:23.383033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb37fa1-afed-48b4-8f85-1351e1cb2c43 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.392309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:23.436044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.436723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.437008 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.437284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.512322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.513906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.619817 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 214/428] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:23.627844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:23.755651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a50e2-c8f4-4d5b-a479-eedb910bd874 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.797830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.798747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.799035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.799311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] PATH_INFO: `/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.801901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] RBAC: Authorizing `identity:get_project(project_id=43b2d39d45e94b0d9647158a36f7f5cb)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.803411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf2b00-8e34-4d20-9228-e3ff4ebf9da3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.805157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 215/429] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:23 2022] GET /identity/v3/projects/43b2d39d45e94b0d9647158a36f7f5cb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:23.810714 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:23.823034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:23.918341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1ced-94b7-457b-a8b0-8ee82cbfc126 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.918738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1ced-94b7-457b-a8b0-8ee82cbfc126 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.918947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1ced-94b7-457b-a8b0-8ee82cbfc126 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.920523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 216/430] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:23.926429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.927255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a8dd-ff63-40ae-a118-f9bd213cd4e9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:23.927577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.928055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.947758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:23.949421 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:23.970080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:23.985529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:23.986527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:23.986845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:23.987124 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:23.988467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:23.990090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:23.992101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 215/431] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:23 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:23.998510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.054416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 217/432] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:24.084003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.103867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.139554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114af11-e4bf-4ad2-9357-d9d556b4c77c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.185972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.185972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.185972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.186519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.187045 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:24.187360 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:24.188835 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78df847-1f6e-4e51-b9b1-3661d943a8b7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:24.202588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 216/433] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:23 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=43b2d39d45e94b0d9647158a36f7f5cb&role.id=c648a19d06904216a8c19d1bf459539b => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:24.202588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296226-3158-4617-981c-8fdc511f9cbc None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.202588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296226-3158-4617-981c-8fdc511f9cbc None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.202588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296226-3158-4617-981c-8fdc511f9cbc None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.202588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 217/434] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:24.205812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.206108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.206471 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.227789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:24.229023 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:24.248728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe20020-c1aa-401b-a72f-856bfc558f2e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.295870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.296720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.297292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.297577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.313945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:24.322895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 218/435] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:24.326102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:24.327105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:11:24.328039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:24.332586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 218/436] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:24.333687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.347760 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.371110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.418193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.466200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9347085-bd97-464d-8206-e5c80be6d0eb None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.477507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278718b6-7711-4157-9464-938fb2437a2e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.511141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.512738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.513219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.513684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.515093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:24.515845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:24.517443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:24.520913 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.521814 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.522105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.522601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.528031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 219/437] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:24.533990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.537170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:24.548369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:24.549410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:24.550292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:24.552998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 219/438] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:24.558478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.643068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.675742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180183-4b4b-4c8c-bf57-21c407af13a8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.692769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2254-d0b7-4588-9ab6-4091e17b344d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.711132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.719986 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.720936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.721414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.721691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.734331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.735441 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.735715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.735915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.736694 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:24.737101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:24.738413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:24.747212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 220/439] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:24.752708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.799067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:24.800548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:24.865473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbb11-0b86-4dbe-ae6b-6bd46a763046 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:24.898522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.905519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:24.906178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:24.906462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:24.906764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:24.908970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 220/440] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:24.914480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:24.943580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:24.989632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:24.991292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea75c40-3bf6-46ae-bc1e-b46d296ad3c5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.019002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1dc8-6cb9-4da3-a45f-ba21eb5385d1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.052122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.052994 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.053276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.053554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.054795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.056318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f015f1-1e37-402d-ba6e-3e7af9da54e3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.058031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 221/441] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.059226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a1dd-07dc-4034-bd21-aea14c1425e9 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.059515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a1dd-07dc-4034-bd21-aea14c1425e9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.059791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a1dd-07dc-4034-bd21-aea14c1425e9 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.061154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 222/442] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:25.063561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363a1dd-07dc-4034-bd21-aea14c1425e9 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.097808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 221/443] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:25.099818 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.100167 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.100459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.117176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:25.118468 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:25.143010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.163309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.172445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363a1dd-07dc-4034-bd21-aea14c1425e9 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.192299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 222/444] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:25.192915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.213854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.214838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.215128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.215449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.216643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.218093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.219915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 223/445] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.220591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.294843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191ddcc-afe7-441f-a1f2-24d78e0e8681 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.322180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133cc5-0f13-4418-b344-eb15d7b22c57 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.327847 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.328707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.328983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.329241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] PATH_INFO: `/v3/projects/f4ec857a65db46b688a3ebffadf38a09` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.330449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] RBAC: Authorizing `identity:get_project(project_id=f4ec857a65db46b688a3ebffadf38a09)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.331947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.338305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 223/446] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/projects/f4ec857a65db46b688a3ebffadf38a09 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.338305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.356852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.357654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.357936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.358209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.368175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:25.368387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:25.376095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:25.377280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:25.378199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 224/447] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:25.379001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.405148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.442633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d31ebf-1b42-49da-9bd2-55df0287df1b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.479975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.480651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.480935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.481216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.482074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=8f8bd3a52aba4305935aa947f1f725ca, scope.project.id=f4ec857a65db46b688a3ebffadf38a09) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:25.482233 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03810-004d-4d2f-a981-9092eb4d2638 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.482352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.483848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.489735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 224/448] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=8f8bd3a52aba4305935aa947f1f725ca => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.490511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.522124 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.523305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.523587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.524394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] PATH_INFO: `/v3/groups/6a364a15257642b9bfae23b5eb62c776` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.525840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] RBAC: Authorizing `identity:get_group(group_id=6a364a15257642b9bfae23b5eb62c776)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.527534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.530002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 225/449] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/groups/6a364a15257642b9bfae23b5eb62c776 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.535338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.596529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.609264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ff1a-71e8-44e4-93f0-c490ebd858a4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.647987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.648684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.648975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.649241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.649573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.650016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:25.650320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.651798 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.661258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 225/450] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:25.661494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d023-be54-4917-82ba-3af37c619e6e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.667092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:25.706259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.707247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.707702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.707982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.708849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] RBAC: Adding query filter params (group.id=6a364a15257642b9bfae23b5eb62c776, role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=f4ec857a65db46b688a3ebffadf38a09) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:25.709167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.710744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:25.717409 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 226/451] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/role_assignments?group.id=6a364a15257642b9bfae23b5eb62c776&scope.project.id=f4ec857a65db46b688a3ebffadf38a09&role.id=c648a19d06904216a8c19d1bf459539b => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:25.790021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b596-333b-4f97-bdb9-348b6bbcc0c0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:25.831758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:25.832434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:25.832710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:25.832991 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:25.865284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:25.914547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:25.916104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:26.016917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 226/452] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:26.022846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:26.124546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f601c09-72e7-4bc8-b265-185949a77e9c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:26.156942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:26.157812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:26.158093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:26.158371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] PATH_INFO: `/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:26.159738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf486d74afa4d19ae43e59f70caf3c5)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:26.161238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:26.162987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 227/453] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:11:26 2022] GET /identity/v3/projects/8bf486d74afa4d19ae43e59f70caf3c5 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:26.168887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:26.228524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:26.278921 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace64fe-95c8-4025-b2de-e1f348e435c9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:26.313776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:26.314641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:26.314983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:26.315258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] PATH_INFO: `/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:26.316461 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] RBAC: Authorizing `identity:get_group(group_id=32ee5fdf35c2401b83ccb8293ed3f3d4)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:26.317902 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb332e0-05a5-4756-a093-3490c44b9b4e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:26.319575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 227/454] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:11:26 2022] GET /identity/v3/groups/32ee5fdf35c2401b83ccb8293ed3f3d4 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:26.326201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:26.363703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:26.441271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd0bb-4255-4302-9e8b-d8ce074e0260 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:26.484660 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:26.485342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:26.485626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:26.485900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:26.486841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] RBAC: Adding query filter params (group.id=32ee5fdf35c2401b83ccb8293ed3f3d4, role.id=3d4222f61d774512b154900643156352, scope.project.id=8bf486d74afa4d19ae43e59f70caf3c5) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:26.487290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:26.489377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8d1c9-abe4-44c3-aa74-d44038892845 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:26.497483 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 228/455] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:11:26 2022] GET /identity/v3/role_assignments?group.id=32ee5fdf35c2401b83ccb8293ed3f3d4&scope.project.id=8bf486d74afa4d19ae43e59f70caf3c5&role.id=3d4222f61d774512b154900643156352 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:29.076240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077076d-3001-4967-8da6-ce031f8f8e95 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.076804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077076d-3001-4967-8da6-ce031f8f8e95 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.076804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077076d-3001-4967-8da6-ce031f8f8e95 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.078393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 228/456] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:29.084246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb678-8e3e-4175-a271-84ad0db191b2 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.085140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb678-8e3e-4175-a271-84ad0db191b2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.085623 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb678-8e3e-4175-a271-84ad0db191b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.111697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9adfb678-8e3e-4175-a271-84ad0db191b2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:29.113274 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9adfb678-8e3e-4175-a271-84ad0db191b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:29.205421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 229/457] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:29.250274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077076d-3001-4967-8da6-ce031f8f8e95 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.269150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226380e-d009-442b-8b9e-c7b1961679ae None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.270106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226380e-d009-442b-8b9e-c7b1961679ae None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.270604 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226380e-d009-442b-8b9e-c7b1961679ae None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.273107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 230/458] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:29.291735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.292528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.293041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.324490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:29.327846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:29.359029 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.424371 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077076d-3001-4967-8da6-ce031f8f8e95 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:29.436116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 231/459] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:29.463947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.483064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.503772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:29.504582 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.504863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.505135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.515908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:29.517379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-7e6c0279-4265-4ff7-b93a-0c2882828c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:29.543604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:29.544676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:29.545718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:29.545718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:29.545718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:29.545718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:29.548211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 229/460] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:29.549676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73986d2e-9378-4949-8f63-e52e8484fc5a None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.549961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73986d2e-9378-4949-8f63-e52e8484fc5a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.550234 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73986d2e-9378-4949-8f63-e52e8484fc5a None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.551948 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 230/461] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:29.554213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73986d2e-9378-4949-8f63-e52e8484fc5a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.613286 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e6814-09f3-404d-997d-0414d5f71c9e None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:29.658195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:29.660075 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.660598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.661087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.662915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73986d2e-9378-4949-8f63-e52e8484fc5a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:29.674789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:29.676543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:29.688588 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.701963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:29.702905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.703365 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.703790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-fa46a1e2-0ef7-4fe1-9507-816ea6d806a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:29.703935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:29.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:29.705749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:29.705749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:29.705749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:29.705749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:29.705749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 232/462] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:29.707358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.707632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:29.707737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.708060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.708402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:29.709981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:29.723639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 231/463] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:29.724835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.730049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:29.731467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:29.762085 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.818811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 233/464] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:29.819984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.832041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9058d9-ce99-4202-a6fa-60814958453f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:29.866776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:29.867876 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.868516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.869083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.870048 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:29.870532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:29.872266 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:29.885769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 232/465] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:29.886964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:29.951855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0ee5-a4b6-49a6-9b03-f6a0a106ee82 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:29.986032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.989716 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:29.994808 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:29.995519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:29.995805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:29.996086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:29.997547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:29.999359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.001469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a707b9-acc1-44d3-ada2-8cd03d0e5bd4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.025079 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 234/466] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:29 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:30.026260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.041903 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.043206 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.043675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.044145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.056697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.058662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:30.078327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:30.079846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:30.080875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:30.080875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:30.080875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:30.080875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:30.083360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 233/467] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:30.100309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.151414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde32b9-a5ef-4f01-95f5-2dc0dbb6f565 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.190916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.191620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.192004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.192286 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.193136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.194651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50899151-ee99-43eb-a4e7-85af434cb397 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.221511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 235/468] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:30 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:30.223123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad3f09-5c7b-40cc-88a2-df49b4345847 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.223771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad3f09-5c7b-40cc-88a2-df49b4345847 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.224118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad3f09-5c7b-40cc-88a2-df49b4345847 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.225935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 236/469] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:30.240536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.240900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.241189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.265887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:30.267150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:30.268882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074868-449b-4ef5-aaa6-701c335085fa None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.310639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:30.310916 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.312523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.312815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.313096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.313873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:30.314186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.315781 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.333147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 234/470] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:30.339786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.353022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:30.367167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 237/471] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:30.393101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.502435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2ebc4-a73a-432f-bd13-5d9302cd4741 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.529930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a19ee-6dbf-40b3-8e34-7b290739cb2f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.544832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.545527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.545815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.546097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.546922 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.548446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.574964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.575191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 235/472] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:30 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:30.576223 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.576650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.577065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.593874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.595762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:30.617696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:30.618972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:30.620116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:30.620116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:30.620116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:30.620116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:30.622233 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 238/473] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:30.627947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.710936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:30.771613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a480e5-a013-40fe-8b80-91c905e93df4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:30.823146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:30.823891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.824182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.824462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.825267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:30.825581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:30.826997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749e5a9-f012-4760-b08b-219e0e53b523 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:30.844147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 236/474] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:30.849824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:30.888719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:30.925466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6198e-5a63-41b0-aad3-371e80b5d77e None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.925779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6198e-5a63-41b0-aad3-371e80b5d77e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.926027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6198e-5a63-41b0-aad3-371e80b5d77e None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.927748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 237/475] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:30.933155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:30.933444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:30.933721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:30.960117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:30.961493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:30.970557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daad54-b001-4560-a308-2e2cde76833f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:31.009753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:31.010441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:31.010744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:31.011021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:31.011753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:31.013207 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:31.037929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 239/476] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:30 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:31.071296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 238/477] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:31.094783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:31.189447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:31.216591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9c7dc-9baf-4bf2-98ef-1038c360c116 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:31.263042 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:31.264065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:31.264569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:31.265032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:31.266000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:31.267647 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:31.286282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.sql.core [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:11:31.286282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:11:31.286282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [parameters: {'id': '4469a9d7a3ee4661ad2c5164bceeecc8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:11:31.286282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:11:31.303613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return ref.to_dict() May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:11:31.304855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application yield resource May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise self.value May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application session.commit() May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:11:31.306245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.flush() May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application compat.raise_( May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:11:31.307566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:11:31.308838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:11:31.310078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [parameters: {'id': '4469a9d7a3ee4661ad2c5164bceeecc8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:31.311295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:11:31.312430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:31.315263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 240/478] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:11:31 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:31.322823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:31.380515 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:31.428144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f52c-c20a-4959-828e-6f87ec06dabf None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:31.464613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:31.465702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:31.466168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:31.466595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:31.478200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-a6419128-92a5-4441-a49d-1db665d225b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:31.486936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:31.488033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:31.489600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 239/479] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:31.493944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:31.613747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc03f6-3261-497e-8f58-b7fd3bd93a87 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:31.650298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:31.651041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:31.655076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:31.655364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:31.656160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:31.656480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:31.657935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da514a64-1533-4aa6-bf4b-05220e1b08bf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:31.667460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 241/480] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:32.853564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4695f-04a5-498b-9c79-49f94829b529 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:32.854082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4695f-04a5-498b-9c79-49f94829b529 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:32.854082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4695f-04a5-498b-9c79-49f94829b529 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:32.855709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 240/481] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:32.861497 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:32.861949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:32.862132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:32.874560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:32.880328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:32.881597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:32.953353 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 242/482] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:32.977314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4695f-04a5-498b-9c79-49f94829b529 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.089754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4695f-04a5-498b-9c79-49f94829b529 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.107138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.131425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.132249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.132537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.132815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.147624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-3e674895-b9f3-41cd-8e4a-ec2123ad9c7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:33.155535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:33.156483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:33.157393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 241/483] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:33.162640 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.274928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2bece-417a-43f5-b4d2-b727d5efb2a2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.303878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ace1-5897-4827-92a8-5df68c9fedac None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.304189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ace1-5897-4827-92a8-5df68c9fedac None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.304448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ace1-5897-4827-92a8-5df68c9fedac None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.305882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 242/484] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:33.313722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9439d-6505-4e34-830a-7f7d7836a890 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.314020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9439d-6505-4e34-830a-7f7d7836a890 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.314299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9439d-6505-4e34-830a-7f7d7836a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.321086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.322024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.322469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.322971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.323955 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:33.324421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:33.325967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:33.328470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.342285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 243/485] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:33.343562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.351723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-7ef9439d-6505-4e34-830a-7f7d7836a890 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:33.352988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-7ef9439d-6505-4e34-830a-7f7d7836a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:33.468791 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 243/486] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:33.470261 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770cd82-162e-4bd2-9884-e5c5ea2fd53f None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.470556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770cd82-162e-4bd2-9884-e5c5ea2fd53f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.470889 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770cd82-162e-4bd2-9884-e5c5ea2fd53f None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.472422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 244/487] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:33.475769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684347b5-29db-4aee-92c2-72549e321810 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.479686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.479984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.480270 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.502464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:33.504060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:33.517452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.518285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.518570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.518887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.531234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:33.532935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:33.551828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:33.552921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:33.553862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:33.553862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:33.553862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:33.553862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:33.553862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 244/488] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:33.554159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.585470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 245/489] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:33.586331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.636048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.640755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.693224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42281-0e13-4947-a06b-a28b2de34091 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.733782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2a93-4d36-427a-8efd-55507cc5371d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.735200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.737310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.737766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.738204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.752040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:33.763187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:33.764397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.765515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:33.768812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 245/490] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:33.770119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.776560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.776560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.776560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.776560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.776949 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:33.776949 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:33.778105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:33.792235 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 246/491] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:33.794043 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.906496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.907178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9dee8-da41-423e-b7aa-a499c2b67379 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.918404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e43652-8674-44b7-8d76-3210d97ab3a7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:33.923067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:33.958799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.959739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.960121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.960468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.961411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:33.962372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:33.962986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:33.963464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:33.964523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:33.965016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:33.966625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:33.975249 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:33.981806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 247/492] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:33.982930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:33.983772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:33.984788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:33.985678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:33.990141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 246/493] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:33.992056 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.111842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d27cd-083a-4d33-8745-dd8d4caf63c4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.117593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c6de-aaa6-4566-b07b-4e85464e2d0c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.153743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.154561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.154854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.154974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.155148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.155652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.155938 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.156216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.164250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.165778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.167150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.168644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:34.181764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:34.182863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 248/494] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:34.188757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4a32b2d3-7109-4523-8c47-ec0e280697a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:34.189481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:34.190348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:34.191342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:34.191342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:34.191342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:34.191342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:34.191621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 247/495] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:34.193056 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695bd-284c-42f6-8f58-6bee81edba25 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.193341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695bd-284c-42f6-8f58-6bee81edba25 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.193616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695bd-284c-42f6-8f58-6bee81edba25 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.194977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 248/496] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:34.195665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5695bd-284c-42f6-8f58-6bee81edba25 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.207571 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.222181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.304313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e4594-9e27-41be-8c82-2edf36f5b4d6 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.307710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5695bd-284c-42f6-8f58-6bee81edba25 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.342967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.343640 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.343920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.344190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.344425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.345040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:34.345343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.345755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.346217 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.346708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.346817 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0404a-367f-4b93-a9a8-f0e187c3d644 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.347740 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:34.348231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.350310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.364885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 249/497] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:34.364885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.393987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 249/498] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:34.393987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.393987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.393987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.408906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:34.410112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:34.457455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.484310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0ecdc-d042-4df4-958f-8b603256c970 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.488404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 250/499] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:34.491594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.507175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.522643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.523442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.523799 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.524149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.524938 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:34.525251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.526647 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.539357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 250/500] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:34.543903 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.597299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe843-7ddc-456e-a925-548cf6821e78 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.632775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.633596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.633872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.634247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.644376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.645858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.646575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11549ca0-321c-4adf-b152-2bf44b462d8e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:34.663469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:34.664491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 251/501] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:34.665577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.681533 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.682191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.682477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.682783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.686424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.731862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.752515 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.753993 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39093-aa22-410f-82e7-dc7d71c6fc70 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.773308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eb72a-70cf-43be-afe2-fb181084763b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.806437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.807321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.807618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.807892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.818082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:34.825877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:34.827040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 252/502] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:34.827923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.857320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 251/503] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:34.858662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb7a8-23fd-45b0-b099-60f1eb0f8357 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.859052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb7a8-23fd-45b0-b099-60f1eb0f8357 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.859336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cb7a8-23fd-45b0-b099-60f1eb0f8357 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.860763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 252/504] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:34.861291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cb7a8-23fd-45b0-b099-60f1eb0f8357 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:34.896438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.932274 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115507ae-d8ca-4023-bb8d-4759f1babd1a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.954334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:34.963173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cb7a8-23fd-45b0-b099-60f1eb0f8357 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:34.967539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:34.968384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:34.968672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:34.968950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:34.978918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:34.980394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:34.995690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:34.996901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 253/505] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:34.998104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.000238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.000919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.001472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.001755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.003340 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:35.003658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.005061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.018707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 253/506] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:35.018707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.104552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082404b-f826-4214-81c4-13ca531039e5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.117652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.123690 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f609211-b553-4208-a565-bac2fab3eda8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.137556 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.138234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.138523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.138842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.139618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:35.139934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.141378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051f3c1-2d1f-4233-905e-30a01c58739c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.149706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 254/507] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:35.150820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.151052 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.151333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.161019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.161829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.162117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.162401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.167939 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:35.169150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:35.174412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.175914 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:35.193397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:35.194385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 254/508] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:35.195684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.214561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.241992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 255/509] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:35.242872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.297754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e72ff-0b70-4fa5-b0ae-638a9999d18d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.330628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.331332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.331622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.331901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.332752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:35.333062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.334507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.346771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e94f6-97d2-4369-919b-adf1f1cde81c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.371092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 255/510] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:35.371848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.380468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.381266 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.381407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.381600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.381821 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.389392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.390890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:35.405718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:35.406747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 256/511] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:35.407750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.441366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.491216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd024cd-1b10-4340-bd61-a1a1a167c755 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.511523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a067-466f-4dba-a4a1-2337022530e6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.524668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.525478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.525762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.526059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.536139 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.537615 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.546121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.546833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.547123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.547398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.548135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:35.548443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.549829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:35.556237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:35.557330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 256/512] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:35.559204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.564231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 257/513] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:35.564922 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.616479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.659567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7d0eb-8b3d-4325-b25b-d2a074182ba4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.661360 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.668757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230509a7-6aed-4feb-94d2-03ff77b4f2b5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.695501 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.696562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.696860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.697119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.703774 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.704424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.704706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.704980 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.707564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.709041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:35.727173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:35.728314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:35.729494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:35.729494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:35.729494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:35.729494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:35.729494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 257/514] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:35.730028 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.776285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.777800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.830878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3026e0c-8a40-425d-b930-cc822f030db2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.841299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.865413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:35.866205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:35.866490 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:35.866793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:35.867652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:35.867966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:35.868375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:35.869569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:35.877307 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 258/515] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:35.878125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.891965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 258/516] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:35.892782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:35.978822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec682f45-620e-4246-bfde-17aa36922520 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:35.993142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0697-e2ba-440f-928c-8047be69de4b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.014155 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.014885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.015178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.015458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.016206 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:36.016521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.018024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.028045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.028849 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.033394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.033534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 259/517] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:36.033630 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.033740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.039174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.040729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:36.055143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:36.056111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:36.057064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 259/518] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:36.057615 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.085536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.087540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.133048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628dda-86a1-483e-a73f-7103527651c3 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.159529 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b6db-001c-4263-95b5-5ada45db6029 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.168871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.169556 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.169864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.170137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.170901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:36.171213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.172603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.184291 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 260/519] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:36.185080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.192801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.193605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.193894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.194172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.204854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.206397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:36.224314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:36.225425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:36.226425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:36.226425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:36.226425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:36.226425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:36.226425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 260/520] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:36.226761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.287517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec871-89de-4a4a-b66d-2f457dc298de None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.301145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.311641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.321933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.322603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.322908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.323179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.334987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52955d-3838-435c-8dde-50807c47689a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.369365 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.370163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.370442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.370728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.378243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.379756 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.389989 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.391503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:36.394476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:36.395793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 261/521] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:36.396802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.491340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 261/522] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:36.492183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.502008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8d7be-eb97-4630-8504-2bbb8f2a4e09 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.508169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.535277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.536018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.536371 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.536679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.537480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:36.537856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.539253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.553539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.557107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 262/523] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:36.558418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.592883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6e74-108c-46cd-8542-2e02077f5b9c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.626320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.627022 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.627310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.627590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.628311 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.629770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.651216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 262/524] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:36 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:36.652039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.661307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f796b9-2a42-4040-87ba-64db3a833809 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.702883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.703571 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.703861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.704141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.704893 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:36.705210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.706635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.724494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 263/525] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:36.724494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.740923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.783397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5548da-dfdc-4a35-a093-3217e799c5ee None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.798534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:36.824382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.825085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.825370 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.825649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.826528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:36.826875 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.828355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.848070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 263/526] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:36.849429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.855731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee343a-9fba-4afc-9529-e992baf52ae7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.897347 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:36.898172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:36.898458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:36.898790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:36.911321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:36.912802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:36.932140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:36.933168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:36.934159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:36.934159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:36.934159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:36.934159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:36.934159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 264/527] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:36.934447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:36.967715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892dc67-f817-4ceb-ad0e-ed84abc7876a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:36.995868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.004599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.005491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.006224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.006224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.007037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:37.007382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.008848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.014824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 264/528] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:37.015554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.061283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5eef2-e0f0-4656-a839-2f741f77742e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.078666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.106145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.107026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.107790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.107790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.116867 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.118593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:37.135238 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:37.136435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:37.137569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 265/529] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:37.138625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.157482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85b0f7-be93-4ca7-aea1-edc82309970d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.200085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.200861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.201148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.201428 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.269918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.281437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.282117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66f51a-77eb-4740-a125-b2c07f0e7f08 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.282985 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.328081 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.329262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.329704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.330290 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.331586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:37.332317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.334022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.349728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 266/530] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:37.350952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.387503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 265/531] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:37.392677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.392842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.479611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04674b3-4161-4f5c-b7e8-4d13456d73dc None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.502836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.513518 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ff339-0d16-462b-8100-045e06415084 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.519567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.520493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.520930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.521357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.522304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:37.522782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.524390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.538315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 267/532] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:37.539484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.550363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.551208 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.551551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.551832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.559230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.560749 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:37.575852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:37.576846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:37.577803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 266/533] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:37.578362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.660651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.675464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a219f-21c6-4bf6-9176-4a7970e4f469 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.710002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767794-8cc8-49c6-944c-03fdd990011a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.718408 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.719264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.719551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.719827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.734260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.735788 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.753472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:37.754419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:37.754930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:37.755421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:37.756514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2ac573645280440090b935239297826d) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:37.757166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:37.757891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:37.758827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:37.759776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:37.759776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:37.759776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:37.759776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:37.759776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 268/534] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:37.760490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:37.764639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.768934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 267/535] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/role_assignments?user.id=2ac573645280440090b935239297826d&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:37.771193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:37.807051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:37.948512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb363-0a2b-4ee3-8b16-5ac52f3c4991 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:37.995647 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5f56-753e-4c7d-8879-5aa082b2f87e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:38.028099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.028856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.029144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.029456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.030213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:38.030566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.032046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.040633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.041651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.042149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.042658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.043697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:38.044216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.046446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.059974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 269/536] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:38.060997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 268/537] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:38.067692 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:38.067818 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:38.082107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:38.174277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb10a9-5db1-4a72-90da-17379fe6a52a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:38.208816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.209406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.209691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.209966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.210857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=1e8cc4a6d68f4df09f2bbdb89ff11119) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:38.211173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.212789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.218897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 270/538] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:38 2022] GET /identity/v3/role_assignments?user.id=1e8cc4a6d68f4df09f2bbdb89ff11119&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:38.253239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:38.290536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc62ab0-9ce5-4b3e-993f-b0a7777a8a58 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:38.336433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.337333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.337618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.337889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.355589 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.357092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:38.371664 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:38.372783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:38.373720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 269/539] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:38.379104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:38.499674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:38.544535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ea6c4-1d64-45c5-baf9-7b9a34a6b655 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:38.593369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.594057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.594342 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.594616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.595472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:38.595784 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.597228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f3f9e-1119-48e4-b115-469d47e43a8b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.610850 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 271/540] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:38.616704 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:38.726634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adb2e-00e2-48f5-81b7-ff1e2f679ee5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:38.761257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:38.761838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:38.762119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:38.762394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:38.763371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=74e758c81d1a49f98826472746ae9e1e) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:38.763684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:38.765201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281887-8256-4cb2-8472-c3254e62aee1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:38.771525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 270/541] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:38 2022] GET /identity/v3/role_assignments?user.id=74e758c81d1a49f98826472746ae9e1e&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:38.775084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:39.184318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da0b6-dc2e-4d12-9ccd-481161c03910 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.184858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da0b6-dc2e-4d12-9ccd-481161c03910 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.184858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da0b6-dc2e-4d12-9ccd-481161c03910 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.186382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 272/542] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:39.191876 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.192380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.192491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.220052 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:39.221263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:39.308993 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 271/543] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:39.356276 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325da0b6-dc2e-4d12-9ccd-481161c03910 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:39.478585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325da0b6-dc2e-4d12-9ccd-481161c03910 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:39.508085 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:39.525978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:39.526856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.527155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.527418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.540866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-373fc9fe-907b-4e4b-988a-ef68fbeffdf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:39.550596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:39.551625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:39.552541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:39.553226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 273/544] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:39.559798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:39.705092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3511db-dbe2-47b7-8b0e-d275f25a5060 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.705801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3511db-dbe2-47b7-8b0e-d275f25a5060 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.706317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3511db-dbe2-47b7-8b0e-d275f25a5060 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.708276 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 274/545] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:39.715282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.715853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.716332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.717933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5f20b-9e09-4edf-bd9d-497cea6d3d83 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:39.747921 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:39.748751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:39.749375 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:39.765565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6581-633b-432c-9b96-19909cef78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:39.766310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6581-633b-432c-9b96-19909cef78df None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:39.766600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6581-633b-432c-9b96-19909cef78df None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:39.766890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6581-633b-432c-9b96-19909cef78df None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:39.767667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6581-633b-432c-9b96-19909cef78df None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:39.767977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6581-633b-432c-9b96-19909cef78df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:39.769434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6581-633b-432c-9b96-19909cef78df None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:39.785861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 272/546] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:39.791537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6581-633b-432c-9b96-19909cef78df None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:39.819438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 275/547] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:39.853920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:39.997510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff620ff-b930-42ff-bcdd-fa08a5be38bd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.023272 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.028659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6581-633b-432c-9b96-19909cef78df None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.039359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.040551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.040852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.041133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.053600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:40.062636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:40.063654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:40.064535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:40.065201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 276/548] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:40.070443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.135404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.136229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.136522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.136806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.162810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.164290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.183200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acdda4-aee3-4589-b061-c4bf6518b7dc None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:40.207337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:40.209851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:40.212065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:40.212065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:40.212065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:40.212065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:40.212065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 273/549] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:40.222105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.222878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.223166 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.223769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.223997 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.224587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:40.224901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.226311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.236535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 277/550] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:40.242082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.290860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.358100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.364253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6d7e1-655f-4737-90bb-65d3f88042ca None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.408292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.409399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.410084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.410574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.423854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.426138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:40.447464 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:40.448462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:40.449414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:40.449414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:40.449414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:40.449414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:40.451861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 278/551] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:40.458027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.491541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc98d-58e8-4fd9-a8d7-e5382a0ae925 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.535816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.536490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.536780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.537058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.537836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:40.538539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.539788 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ea5e-524b-4539-b3e2-49ba2bb72636 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.553245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 274/552] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:40.554851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64dec-7afd-498a-8a6e-d23cf3be1cc3 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.555162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64dec-7afd-498a-8a6e-d23cf3be1cc3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.555452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff64dec-7afd-498a-8a6e-d23cf3be1cc3 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.561003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 275/553] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:40.561821 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64dec-7afd-498a-8a6e-d23cf3be1cc3 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.572645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.584833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27d07b-e36e-48da-9e0f-b9cd9e3d4140 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.625392 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.626101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.626390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.626924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.627492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:40.627804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.629269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056ffe-0f71-4974-9aaf-1c34a40bc06b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.646753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 279/554] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:40.646753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.646753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.646753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.662386 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:40.663674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:40.686251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff64dec-7afd-498a-8a6e-d23cf3be1cc3 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.689031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.727891 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.729232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.729753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.730239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.739730 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 280/555] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:40.739939 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.742117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.747718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:40.760829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:40.761947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:40.763058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:40.765737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 276/556] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:40.773570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.847362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:40.867977 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbf10-d8f6-4e47-bd7b-4254ba43d5f3 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.896827 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f808-e7b1-462e-8982-f38fb1c43647 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:40.908555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.909316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.909606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.909882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.918001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.919719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.933778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:40.934163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:40.935380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 281/557] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:40.936517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.937761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.938049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.938326 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.939308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:40.939624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:40.941080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111a21-2578-4bbb-b7a5-d32c26b69d03 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:40.962577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 277/558] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:40.964043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2d9e-6753-4d04-911e-4e480426a77c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:40.964343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2d9e-6753-4d04-911e-4e480426a77c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:40.964628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc2d9e-6753-4d04-911e-4e480426a77c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:40.969837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 278/559] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:40.969837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2d9e-6753-4d04-911e-4e480426a77c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:40.998409 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.053720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a14b0-29a3-4a23-987b-5740e6eda174 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.080404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc2d9e-6753-4d04-911e-4e480426a77c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.094198 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.095056 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.095391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.095710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.108926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:41.115974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.116657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:41.116844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:41.117878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:41.118924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:41.119632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.119632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.119632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:41.119632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.119901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 282/560] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:41.119901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.120691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b304db-23be-4f6e-8d59-4f5a6fb67e37 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.122838 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.147303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 279/561] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:11:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:41.152150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.152716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.153004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.170930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:41.172240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:41.241545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 280/562] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:41.243197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.250203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356472a-c43a-4dc1-aeb9-4e5b0b4c74bd None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.257802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.291348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.292016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.292304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.292586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.355333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84d426-a645-4178-92b8-b51ae0df3a6d None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.367963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.369898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.372242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.389703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.390390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.390675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.391192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.391748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:41.392063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.393445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.406432 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 281/563] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:41.406432 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.477369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.483466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 283/564] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:41.485284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.510322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a74be-1bc8-4da2-873a-2b82407f808e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.545745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.546549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.546869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.547145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.557932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.559429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:41.576540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:41.577676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 282/565] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:41.579217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.585505 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a78fb-33c1-4f76-a1be-ce6beca2707d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.587192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.621207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.621919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.622213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.622489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.632936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-e617d62f-4d52-4222-8584-0cbe0661766c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:41.640701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:41.641834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 284/566] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:41.643176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777faf5-e52f-4295-be9b-ee706830355f None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.644179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777faf5-e52f-4295-be9b-ee706830355f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.644179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777faf5-e52f-4295-be9b-ee706830355f None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.645237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 285/567] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:41.645918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777faf5-e52f-4295-be9b-ee706830355f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.683132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1020e7-767b-4632-85c3-42d1dd22dba9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.705338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.717147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.717959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.718246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.718526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.729363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.730850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:41.747622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:41.748651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:41.749596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:41.749596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:41.749596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.749596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:41.749830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777faf5-e52f-4295-be9b-ee706830355f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.750055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 283/568] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:41.750055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.786644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.787475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.787763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.788041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.799437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.800890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:41.817985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:41.819184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 286/569] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:41.820481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.836647 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.847503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1344bda-1026-48c9-adcc-3e29879a6928 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.882475 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.883176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.883456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.883729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.884517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:41.884839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.886204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263601b-c474-4e21-a11e-f89be6614da4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.898065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 284/570] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:41.899418 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.899702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.899975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.915660 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:41.916834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:41.930438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d8a-bb0e-490e-905e-20443bce5fda None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:41.944451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:41.963763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:41.964807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:41.965092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:41.965367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:41.966131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:41.966441 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:41.967854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:41.975994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 287/571] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:41.976763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:41.984671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 285/572] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:41.985513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.072215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.084536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0bc90-fb1a-4d6a-b73a-dbb2e677c2c8 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.096183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862081fc-083a-4111-ae66-c8b29a599f4a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.119368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.120039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.120317 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.120574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.121347 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.121630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.123073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.131192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.131860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.132148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.132423 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.133214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.133470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.133996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 286/573] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.134816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.135008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.147200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 288/574] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.148688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.167198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.239406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fe959-564d-4f0d-b315-ce16fc11bbfe None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.248132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad11a2-32e9-4b95-b62f-b3fcc961c14d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.272150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.272950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.273232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.273508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.280159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.280948 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.281608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.281744 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.282028 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.282305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.284996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.293178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.294612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:42.296125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:42.297316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 287/575] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:42.298587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:42.318129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:42.319202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 289/576] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:42.320153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.386766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.402051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3f0d-1dc1-4895-9c63-7bf59b5a6443 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.427367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966eeb-388f-4f7a-a913-93b5acce0099 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.446129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.447125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.447474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.447897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.459489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:42.467391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:42.468465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:42.469365 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 288/577] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:42.470849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.479326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.480332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.480704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.480979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.488992 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.490738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:42.504832 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:42.505813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 290/578] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:42.507059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.560014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.575807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662870-7a61-4fe0-8923-1982dfa6e383 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.609242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.610076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.610347 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.610667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] PATH_INFO: `/v3/users/glance` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.613060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632644-8c45-4d23-9f3a-581b2be8c559 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.618204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.619696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:42.633814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:42.635083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 289/579] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:42.636400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.646204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.649643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.650309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.650594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.650933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.651748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.652064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.653517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.666567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 291/580] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.667393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.738304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e607e-17d5-4a34-b76c-64d6535668da None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.765469 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4bbb-8e6e-4f8b-8dcd-c0f5763197aa None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.770708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.771406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.771694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.771973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.772705 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.773015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.774422 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.775052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.786947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 290/581] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.787615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.804066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.804750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.805031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.805302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.806086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.806390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.807807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.815773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 292/582] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.816533 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.853225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:42.887922 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c5a44-1c0f-4e5c-bf66-5e74d65fee65 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.914711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a81-40fb-4443-bb74-66625cd9c73f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:42.923833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.924541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.924825 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.925100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.925906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.926220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.927726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.946083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 291/583] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.947112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:42.952945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:42.953631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:42.953924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:42.954202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:42.955110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:42.955425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:42.956870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:42.980776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 293/584] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:42.980776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.005690 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.049187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf7dc6-3815-4935-beef-d592cbfeda53 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.074338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.077814 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba2fe-2fa9-414a-a59f-a97b6399ffae None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.084235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.085454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.085738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.086020 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.101617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=c7e4a6850d01483b9f9c5ceabd562d91, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.103407 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.113697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.114506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.114897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.115175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.116920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 292/585] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:42 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:43.117845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.124162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.125670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:43.145157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:43.146277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:43.147415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 294/586] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:43.148808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.244722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe208-4e10-4bb4-8ac0-df80de9cc3e4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.245249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.258836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6364c-c5e3-461d-8290-40985dd16972 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.282460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.283312 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.283597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.283870 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.295462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.296957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.299444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.300123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.300405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.300683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.302031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=68b6190e55004134ac73b357fa14abe6) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:43.302031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.303994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.309643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 295/587] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/role_assignments?user.id=68b6190e55004134ac73b357fa14abe6&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:43.310796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:43.319308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:43.320349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:43.321390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:43.321390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:43.321390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.321390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:43.321813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 293/588] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:43.326759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.357315 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.445180 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703a0db-9bcd-434b-afab-f7c9c8b684af None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.450944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69ef81-dc00-4e6d-bf05-3e6df5343929 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.490251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.491692 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.492149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.492719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.504241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.504848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.505177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.505456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.506191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.506318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:43.506615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.507728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.508095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:43.528718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:43.529793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:43.530778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:43.530778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:43.530778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.530778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:43.531036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 294/589] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:43.531123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 296/590] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:43.535324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.535882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.540827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.647028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.663697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4982f-7b58-40da-ab50-85fa628e1bdb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.666257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1581-b87b-4136-b7b1-b59a51461eb9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.699580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.700353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.700683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.701161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.710297 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.711495 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.711702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.712206 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.712636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.713272 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.713696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:43.714170 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.716189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.730113 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 295/591] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:43.731300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:43.733608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:43.734748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:43.735974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:43.735974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:43.735974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:43.735974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:43.738798 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 297/592] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:43.739654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.817436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.853533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccea03b-c4de-4155-b7cf-b8bd84107826 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.879398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66e135-63a3-46b3-8a78-99b05b0acdf8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:43.900883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.901728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.902190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.902497 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.903381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:43.903792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.905394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.918830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 296/593] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:43.920071 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:43.922306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:43.923428 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:43.923876 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:43.924394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:43.929663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:43.933706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:43.935446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:43.952702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:43.953780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:43.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:43.957680 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 298/594] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:43.958776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.026189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937478b-6501-42c3-9906-3faf0b179213 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.061183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.061963 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.062157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.062423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.063264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:44.063502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.065074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.069162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940a7b-c5cb-414e-a6a3-6198a9a7420d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.077761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 297/595] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:44.078609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.088384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.110986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.112359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.112856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.113346 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.121168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.123044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:44.138527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:44.139632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.140573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:44.143171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 299/596] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:44.144416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.148029 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.188722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f1ebd-cf86-4a1c-a1c7-093e5a593518 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.229112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.229829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.230117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.230396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.231288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:44.231604 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.233069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.251209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 298/597] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:44.252049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.262012 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1db7-cc29-4daa-95ee-2208c981839a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.299789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.301569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.302073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.302758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.311170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.313117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:44.329845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:44.330824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.331767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:44.334337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 300/598] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:44.335489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.357677 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c5ff-1747-442a-b1b4-774bdc191fb6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.374090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.382662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.393738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.394601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.394764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.395038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.395848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:44.396163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.398048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.410929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 299/599] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:44.411782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.456374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c152ef-8381-43cb-958d-e2d2e4ba3702 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.507778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.509145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.509655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.510137 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.521654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5642b-9c8e-4bb1-8c85-d05a304df7d1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.522273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.524159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:44.543546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:44.544547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:44.545593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:44.545593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:44.545593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:44.545593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:44.547975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 301/600] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:44.549119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.557054 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.557734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.558021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.558300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.559136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:44.559450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.560890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.574047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 300/601] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:44.574924 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.621269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.649254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.664006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84feb-d5d0-4228-b798-a31b5e367a6a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.676926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a966-0ae9-456d-bb5f-4c86a3982992 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.701605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.702897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.703483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.703980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2ac573645280440090b935239297826d/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.712131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.712921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.713222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.713996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.714225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:44.714534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.716087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.721827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=2ac573645280440090b935239297826d, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.724122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.728798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 301/602] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:44.729539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.740353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 302/603] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:44 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2ac573645280440090b935239297826d/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:44.741611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:44.847947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff5e0-e5c1-4ee2-94dd-8106ca26925e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.851975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.878625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf31e37-9494-4497-8b2c-dc4a819ff64e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:44.927946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.928793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.929083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.929364 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.930643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:44.931600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:44.931885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:44.932163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/1e8cc4a6d68f4df09f2bbdb89ff11119/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:44.948181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.950068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.952547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:44.964337 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=1e8cc4a6d68f4df09f2bbdb89ff11119, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:44.965829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:44.968578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:44.969686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:44.970644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:44.974448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 303/604] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:44.981950 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:45.017681 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 302/605] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:44 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/1e8cc4a6d68f4df09f2bbdb89ff11119/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:45.107935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e6c7-9467-4be9-868a-142bf5d4a80f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:45.147930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:45.148620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.148902 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.149176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.150042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:45.150349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:45.151851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58f00c-84c4-409a-8ca1-9b93757ebca2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:45.166020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 304/606] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:45.175846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:45.314992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b90c8-4e85-471f-a17b-5b56bbcdb4bb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:45.356856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:45.358205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.359248 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.359752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/74e758c81d1a49f98826472746ae9e1e/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.384326 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=74e758c81d1a49f98826472746ae9e1e, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:45.385814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf4fa8-d580-4d21-a56b-a6b9a02234f4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:45.421384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 303/607] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:45 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/74e758c81d1a49f98826472746ae9e1e/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:45.553579 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ca7-3209-47ac-9dcc-461c0a3ca864 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.554172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ca7-3209-47ac-9dcc-461c0a3ca864 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.554172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d787ca7-3209-47ac-9dcc-461c0a3ca864 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.555889 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 305/608] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:45.561831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b46d-a607-4bc8-b984-f341677aa3e1 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.562181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b46d-a607-4bc8-b984-f341677aa3e1 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.562396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791b46d-a607-4bc8-b984-f341677aa3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.571481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:45.589107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-1791b46d-a607-4bc8-b984-f341677aa3e1 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:45.590342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-1791b46d-a607-4bc8-b984-f341677aa3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:45.687553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 304/609] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:45.724057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787ca7-3209-47ac-9dcc-461c0a3ca864 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:45.782417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f90f-cdd5-4f20-b322-b2038a406590 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.782811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f90f-cdd5-4f20-b322-b2038a406590 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.783012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f90f-cdd5-4f20-b322-b2038a406590 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.784669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 305/610] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:45.796801 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.797146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.797355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.827730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:45.828938 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:45.832722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:45.862366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d787ca7-3209-47ac-9dcc-461c0a3ca864 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:45.910764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:45.911873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:45.912309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:45.912731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:45.913536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 306/611] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:45.924609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:45.932854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:45.934084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:45.935205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:45.937473 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:45.937877 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 306/612] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:45.944954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.004454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.049623 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d2d6b-ad4d-42f7-a508-820686cbd494 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.079244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44230c-1760-4ecf-b665-deb28cccd402 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.086019 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.087063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.087453 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.087834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.099105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:46.100985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:46.107691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:46.109013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:46.110106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:46.117040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 307/613] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:46.118601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.139417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.140367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.140844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.141287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.142226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:46.142713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.144274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.157960 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 307/614] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:46.163684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.228275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36f27-81d8-45cf-ba36-604a98c1f59d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.252913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.265066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.265761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.266047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.266324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.267145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:46.267459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.268903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.282824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 308/615] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:46.285128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.391067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5b70b-7666-40cb-8d68-d221b5a2ddca None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.413667 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b37b5-c37d-42df-9a38-6f987cb94048 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.437369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.438256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.438548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.438853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.462561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.464819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.485553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.486318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.486600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.486919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:46.496119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:46.497072 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:46.498040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:46.498040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:46.498040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:46.498040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:46.498040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 309/616] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:46.503083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.507977 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.509514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:46.537918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:46.539097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:46.540190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:46.540190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:46.540190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:46.540190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:46.540190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 308/617] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:46.547449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.579031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.600915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.687573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b12de6-c4e0-40fb-9733-8bac01c22b27 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.729322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.730028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.730286 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.730564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.731339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:46.731648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.738291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65baada-1064-44dc-a8f0-563bfea0436a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.740398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.763319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 310/618] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:46.772062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.821779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.822459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.822780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.823066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.823823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:46.824136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.825513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.850136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 309/619] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:46.855850 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:46.890544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:46.895097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78525-c9dd-4088-8599-e3120fb7b378 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:46.938234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:46.939070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:46.939356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:46.939633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:46.956457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:46.957930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:46.979887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:46.980936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:46.982016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 311/620] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:46.987613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.102672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47f8f-f176-48d5-b875-472876a0b329 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.111039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.142632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.143505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.143790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.144066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.144941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:47.145255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.145376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89b049-11c4-4d18-bd60-e9daaab8462b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.146828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.173660 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 312/621] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:47.174603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.194133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.225341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.226156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.226442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.226752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.234489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.236003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:47.251792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:47.252869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:47.253976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 310/622] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:11:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:11:47.258913 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.363666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b726a-67d2-400b-9442-1bfd6750f3d0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.402274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.403018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.403301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.403783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.404683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:47.405001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.406466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.412842 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b13aa-0499-49e6-aa10-4c28c0452e78 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.427536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 311/623] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:47.433480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.459080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.548280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.549116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.549407 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.549840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.555878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa189415-ad37-4a32-8d6d-bf7de8f602c4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.587138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.588652 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.594853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.595526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.595811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.596084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-8c8ab13f-aa39-410e-bb56-5052b6cba7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:47.609787 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:47.610904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:47.611857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:47.611857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:47.611857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:47.611857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:47.611857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 313/624] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:47.613544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb50ac-7d35-4296-9fe0-76fa649588cf None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.613544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb50ac-7d35-4296-9fe0-76fa649588cf None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.613544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb50ac-7d35-4296-9fe0-76fa649588cf None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.619333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 314/625] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:47.620078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb50ac-7d35-4296-9fe0-76fa649588cf None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.685260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.687307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa2309-b029-4daf-abd5-9fb32f5a2eee None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.692696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.704347 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.731403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb50ac-7d35-4296-9fe0-76fa649588cf None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.767727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.768409 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.768690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.768970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.769743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:47.770051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.772200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f17b6-5e2d-490c-8388-4a47f874174f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.789243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 315/626] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:47.789243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.789243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.789243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.805224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:47.806557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:47.815009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 312/627] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:47.817048 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94557cd-997f-4222-a0e9-a0c738502a5d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.817345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94557cd-997f-4222-a0e9-a0c738502a5d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.817905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94557cd-997f-4222-a0e9-a0c738502a5d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.819605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 313/628] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:47.820147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94557cd-997f-4222-a0e9-a0c738502a5d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.888587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 316/629] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:47.888587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:47.929019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94557cd-997f-4222-a0e9-a0c738502a5d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:47.940915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.958148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:47.970678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:47.971513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:47.971835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:47.972076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:47.980568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:47.982031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-fea1c6b7-ea04-46ed-ad54-2c9ea019f316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:47.999132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.000284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:48.001229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 314/630] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.001759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.001839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.002293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.014880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce06e-6dd2-4f87-a6c1-3a52df611252 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.019024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:48.020201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:48.050736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.051660 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.051950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.052226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.063355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.065172 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:48.083723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.084690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 317/631] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.085679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.107052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 315/632] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:48.107052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.199545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008f552-08db-43bb-8fae-20d88e1d5582 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.210447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.212066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.215961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4456f-768c-4a05-a726-04ee0e4e420c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.238523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.239357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.239651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.239918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.251081 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:48.253154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.253827 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.254114 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.254391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.255231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:48.255543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.256985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:48.259411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.260393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:48.261278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:48.266087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 318/633] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.267010 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.272315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 316/634] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:48.273030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.377880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe63da-2354-4744-94a5-035a042d2bfa None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.384975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b707c9-a32c-40de-a460-af83ceae5d99 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.411480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.412289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.412581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.412866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.418102 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.418785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.419068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.419340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.420073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:48.420371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.421776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.423477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:48.431447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.432458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:48.433349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 317/635] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.434116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.434824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 319/636] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:48.435874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.457016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.470211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.536688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6c53e-0c2b-4ce7-8101-14ba25d280a4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.542007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164c2-5467-486e-82ba-6c5952195cbb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.570458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.571213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.571499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.571772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.572532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:48.572838 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.574214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648272-16df-471d-b05b-87d9a8c59a44 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.575568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.576467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.576752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.577028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/68b6190e55004134ac73b357fa14abe6/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.582891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 318/637] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:48.584107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f332f-81e5-422a-ad19-52e345ffc363 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.584396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f332f-81e5-422a-ad19-52e345ffc363 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.584673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f332f-81e5-422a-ad19-52e345ffc363 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.586511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 319/638] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:48.591146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f332f-81e5-422a-ad19-52e345ffc363 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.592554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=68b6190e55004134ac73b357fa14abe6, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.594026 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.608775 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 320/639] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:11:48 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/68b6190e55004134ac73b357fa14abe6/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:11:48.609586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.680263 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.703648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f332f-81e5-422a-ad19-52e345ffc363 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.716348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.742751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.743306 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb07c0-d9c5-4dcf-8f50-ad088df038d9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.743488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.743777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.744053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.744836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:48.745146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.746554 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.755814 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 320/640] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:48.756679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.787853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.788696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.788981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.789261 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.797535 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.799041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-f7cc0ba1-59ff-4aa7-985b-b06b359b71b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:48.813712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.814814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:48.815967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 321/641] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.816754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.816903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.817187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.841648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:48.842989 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:48.874340 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c98b45-d82e-4e4c-a9fe-73a47034e67e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:48.909653 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:48.910558 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:48.910988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:48.911277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:48.918744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 322/642] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:48.918744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.928038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:48.929528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:48.932743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:48.950419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:48.951477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:48.952437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:48.952437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:48.952437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:48.952437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:48.952437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 321/643] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:48.952740 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:48.998802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.030087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd995475-2007-4e15-9513-e20708fd1c4b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.062775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fcf0c-1c61-460e-a1f6-39fa2a628ac8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.066229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.067132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.067419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.067697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.078543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.080053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.099924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:49.100122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:49.101038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:49.107186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:49.107186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:49.107186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:49.107186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:49.107443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.107443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.107443 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.107655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 323/644] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:49.107737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:49.107737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.107965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.108046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.119530 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 322/645] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:49.120244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.186422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.216763 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca39bf-cd28-47a6-bd49-6854476f398d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.235777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37535bdf-359a-4b08-9f92-12cca427fbb2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.242408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.256530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.257273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.257956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.258242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.269055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:49.271694 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.272368 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.273008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.273295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.274042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:49.274745 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.276137 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:49.276982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:49.277936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 324/646] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:49.279402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.295344 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 323/647] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:49.296476 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.398314 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0bff-1241-4ee7-a53f-e86ee2d017d7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.405440 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b710259-2c58-47ab-9dcf-900cd250fe44 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.422317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.434236 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.435046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.435391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.435751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.436569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:49.436947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.438404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.442381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.443151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.443507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.443855 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.444780 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:49.445170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.446761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.451300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 325/648] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:49.452326 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.462897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 324/649] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:49.463939 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.510366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.587754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c00c-9c48-4779-92a4-91452e96fc8e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.600548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35029c6-08d9-4249-9bba-db99ddb5e3b0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.641085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.641647 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.641980 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.642271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.642548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.643356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:49.643633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.643754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.644228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.644732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] PATH_INFO: `/v3/users/glance` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.645049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.655500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.655920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 326/650] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:49.656783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.657778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:49.675790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:49.676863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:49.677894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 325/651] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:49.679213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.729964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.787120 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d184-b59e-481f-acf3-88bd743305df None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.790188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:49.804208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbaad4-4365-4e82-bcde-3d073287b6ce None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:49.841107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.841678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:49.842563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.843032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:49.843326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.843500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:49.843967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.844164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:49.854090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.856190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.857847 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:49.859795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:49.872209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:49.873221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:11:49.874243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:49.876948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 327/652] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:49.877959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:49.882205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:49.883201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:49.884269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:49.884269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:49.884269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:49.884269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:49.884269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 326/653] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:49.884976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.000426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68560b99-c17c-4f5e-b068-00f6af8dd2b6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.006273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.018449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895db95-cc77-4818-adb3-65f5cb51bdd3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.039019 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.039631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.039961 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.040241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.041391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:50.042254 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.043809 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.062802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.064099 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.064612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.065095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.070137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 328/654] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:50.070137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.070738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:50.072927 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.074361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.093218 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 327/655] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:11:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:50.094158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.097793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.183218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47202d-3472-40f9-863f-1482d1b3fceb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.221983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.223057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.223916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.224342 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.225259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:50.225822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.227551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.233188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d240fd-8462-4be3-8b3d-ccef62848a43 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.240279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 329/656] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:50.241294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.287816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.288482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.288765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.289091 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.316418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.338949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.359909 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d1f45-7ff9-4217-88b0-f9258d212571 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.392959 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.395134 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.396021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.396765 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.397141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.397489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.468545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.470178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.532254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 328/657] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:50.533310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.582865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.592060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.604667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 330/658] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:50.605715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.657394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d002c-64c4-4826-a1c9-92adcde061e8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.696917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.698156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.698629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.699607 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.710880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.713752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.726947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1cca5-be35-417a-bb0a-1e5ece258f35 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:50.735618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:50.737236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:11:50.738482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:50.746562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 329/659] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:50.746562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.773362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.774333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.774615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.774915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.786340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.787990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:50.806597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:50.807614 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:50.808554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:50.808554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:50.808554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:50.808554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:50.812244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 331/660] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:50.813108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:50.858399 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:50.883732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a02881-fb21-43ae-9fcc-6d3695a2536f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.928344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d5fbb-e3c0-427e-bf2a-e6e6f575ecf9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:50.966936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00242559-0736-41a6-a541-517514ba764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:50.967633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242559-0736-41a6-a541-517514ba764c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:50.967914 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242559-0736-41a6-a541-517514ba764c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:50.968188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00242559-0736-41a6-a541-517514ba764c None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:50.969084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00242559-0736-41a6-a541-517514ba764c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:50.969396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00242559-0736-41a6-a541-517514ba764c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:50.970897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00242559-0736-41a6-a541-517514ba764c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:50.991319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 332/661] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:50.992197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00242559-0736-41a6-a541-517514ba764c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.025015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.053691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.054493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.054813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.055090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.065218 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.067419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-52cb1e59-98c9-4457-886c-a4f1b5c01b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:51.085563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:51.086521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 330/662] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f3f1-4f2e-4426-b564-469d3d77b1ce None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f3f1-4f2e-4426-b564-469d3d77b1ce None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0f3f1-4f2e-4426-b564-469d3d77b1ce None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.092688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 331/663] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:51.093236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f3f1-4f2e-4426-b564-469d3d77b1ce None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.098729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.110222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00242559-0736-41a6-a541-517514ba764c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.150467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.151502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.151931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.152340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.153268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:51.153587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.155602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.174516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 333/664] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:51.174516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.197446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0f3f1-4f2e-4426-b564-469d3d77b1ce None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.232971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.233631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.233919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.234203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.264356 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.285609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13a3fd-fbf2-4763-af45-3f21b2af814e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.309240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.310752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.326094 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.327088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.327562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.328085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.329131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:51.329650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.331452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b58bd-1576-4cf6-bcd1-4eb850baca31 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.346778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 334/665] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:51.346778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.346778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.346778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.364795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:51.365920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:51.374349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.417429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 332/666] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:51.418557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.444511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 335/667] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:51.445635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.492040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.532602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ac58-ecf1-409e-8d43-713d0ab5ae21 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.560768 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aae67-0b2c-42a2-ba0b-b9bc7ef836ea None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.567123 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.567986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.568267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.568544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.576976 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.578458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:51.592522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:51.593513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 333/668] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:51.594508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.602990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.603803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.604078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.604358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.611966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.613456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:51.627679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:51.628606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 336/669] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:51.629613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.633374 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.711165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8650-5186-4c97-8632-999f2cd01c8e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.738306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.744256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5fd8b-0a5b-43bc-8237-a11be87c30f4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.751401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.752259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.752548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.752824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.764781 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.766248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.779763 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.780576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.780859 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.781131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:51.783878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:51.785001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 334/670] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:51.786001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.797386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:51.806616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:51.807658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:51.808557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 337/671] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:51.809289 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.870263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:51.901489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629050a-9e8c-4bf3-9ac3-8c2c0d5874b4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.909982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419ae1d-9207-4c24-94c0-cc3be7dbbdd2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:51.934740 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.935415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.935703 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.935988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.936802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:51.937116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.938564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.943844 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:51.944514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:51.944798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:51.945076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:51.945882 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:51.946260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:51.947752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:51.950564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 335/672] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:51.951392 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.959999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 338/673] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:51.960822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:51.990425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.055273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370fb70-bae1-49c5-9fcd-32c18a8cc473 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.058445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d673c-2519-4136-8adc-cb0f485de386 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.080661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.092088 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.092758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.092956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.093079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.093293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.093584 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.093873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.094033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.094136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.094317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.094912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.095220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.095752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.096620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932d61d-9023-4257-b9ac-da4ddc6db1a7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.105555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 339/674] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.106834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a94420-53f4-47cb-b5ab-074a17a4a937 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.107125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a94420-53f4-47cb-b5ab-074a17a4a937 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.107403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a94420-53f4-47cb-b5ab-074a17a4a937 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.108639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 340/675] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:52.109405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a94420-53f4-47cb-b5ab-074a17a4a937 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.116797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 336/676] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.117951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.210852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.214192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a94420-53f4-47cb-b5ab-074a17a4a937 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.217594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e35fc-ab81-419c-b7a3-d4c2a888def4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.248046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.248801 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.249087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.249362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.250219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2ac573645280440090b935239297826d) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.250496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.250618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.251310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.251611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.251894 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.252013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.252751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=1e8cc4a6d68f4df09f2bbdb89ff11119) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.253070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.254497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb34d8-1540-44da-bf59-850a89313219 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.258161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 341/677] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/role_assignments?user.id=2ac573645280440090b935239297826d&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.258987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.267135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 337/678] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/role_assignments?user.id=1e8cc4a6d68f4df09f2bbdb89ff11119&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.267135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.267135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.267135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.293470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:52.295299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:52.335157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.410587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d63c-898d-4d90-a75c-987ae3e11085 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.418547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 338/679] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:52.418547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.472628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.474380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.474894 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.476004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.489056 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.490535 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:52.517016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:52.518044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 342/680] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:52.519143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.544233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.562382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a6d21-3f66-4287-a171-e6ee23d14188 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.609162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.609992 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.610280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.610560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.619933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.622260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.637634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.641933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2b3a-9bc1-49d9-b002-cbfaea2d8d37 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:52.643636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:52.644565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:52.645676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 339/681] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:52.646186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.682511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.683810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.684379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.684876 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.697284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:52.705956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:52.707016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:52.708609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:52.712352 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 343/682] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:52.718159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.775303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f0aab-e4e2-4459-aed9-d201d4d6fc21 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.811845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.812573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.812809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.813078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.813826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.814138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.815871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.829072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 340/683] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.829873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.831769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0167ce8-00a7-460d-a585-64fd5cc13bbf None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.840904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.870481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.871570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.872078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.872562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.873581 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.874107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.875780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.889149 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 344/684] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.890324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.914302 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:52.938570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ffb-bcc8-45a0-b06e-040dfe483743 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:52.975387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:52.976077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:52.976363 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:52.976649 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:52.977570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:52.977888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:52.979412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:52.993264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 341/685] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:52.994249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:52.997808 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afcf42-d848-4094-85e7-d46b1a285093 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.034034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.035260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.035756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.036315 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] PATH_INFO: `/v3/users/swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.044266 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.046001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:53.061465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:53.062593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:53.063650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:53.066315 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 345/686] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:53.067543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.075879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:53.101821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbab31-5de2-4510-a5a9-aead0f1cd7e2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.139775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.140450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.140883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.141102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.141965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=74e758c81d1a49f98826472746ae9e1e) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:53.142282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.143872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.150632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 342/687] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:52 2022] GET /identity/v3/role_assignments?user.id=74e758c81d1a49f98826472746ae9e1e&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:53.151589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.159925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:53.183920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e061a-7bfa-456a-b278-0f04aed0de5f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.223191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.224717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.225306 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.225881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.241306 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.243486 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.269598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424f82-f883-4db3-8fe4-51fea38902af None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:53.296615 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:53.297636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:53.298610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:53.298610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:53.298610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:53.298610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:53.300740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 346/688] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:53.310796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.312468 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.313163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.313442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.313716 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.314592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:53.314929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.317118 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.318636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:53.338732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 343/689] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:53.348115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.492574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ee0-fd9c-4ec8-b936-9d94d9cc66e8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.543591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.544632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.544923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.545250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.631125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:53.636448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf04f6c-2e3f-4b9e-89c7-a4aa27cd3a7e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.648154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.650371 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.671920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:53.677950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.678639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.678970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.679251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.680011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:53.680324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.681781 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.694417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 347/690] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:53.699661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.811129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63081674-82c4-4fd8-8027-547875d0d065 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:53.847946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:53.849299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:53.849680 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:53.854710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] PATH_INFO: `/v3/users/nova` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:53.858743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:53.860748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:53.877093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:53.878359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:11:53.879655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:53.881618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 348/691] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:53.884672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 344/692] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:11:53.887329 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:53.890542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.019060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.029294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.040098 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b6afa-6396-4eef-9814-bb39c3b87212 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.080247 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.081153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.081439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.081711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.095415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.096888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:54.119291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:54.120321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:54.121313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:54.121313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:54.121313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:54.121313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:54.121313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 345/693] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:54.125882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.164430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0db73-2416-4d76-91db-2bbfae58678e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.237352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2433f-5366-494f-b5f5-41c49708c5a7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.274650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.275358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.275691 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.275965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.276897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:54.277204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.279503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.303925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.304619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.304899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.305225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.306139 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:54.306444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.310331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.327566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 349/694] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:11:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:54.328529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.343256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 346/695] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:54.344230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.354101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.498404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5247c-24e2-40f2-9e6f-b5c681756e2c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.558245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2176-b152-4a68-b5d5-038557ff3017 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.587432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.588689 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.589189 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.589676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.594260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.595041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.595328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.595601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.599534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.612084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.613594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:54.648805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:54.649879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:54.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 347/696] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:54.655700 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.672329 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.674216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49470416-1b0c-4218-a8b4-78ed97c81dbd None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.749356 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.791116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 350/697] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:11:54.792637 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3ba3-03dc-4087-9d0b-0c8930be82d9 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.793032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3ba3-03dc-4087-9d0b-0c8930be82d9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.793411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc3ba3-03dc-4087-9d0b-0c8930be82d9 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.795127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 351/698] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:54.797333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3ba3-03dc-4087-9d0b-0c8930be82d9 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.798405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d323153-86d1-4b3b-869f-e16f830bbdee None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.811743 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:54.840808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.841504 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.841968 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.842253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.843117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:54.843435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.844926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f419f8-4f3c-4f58-9b41-31290387235e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.859075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 348/699] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:54.860471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6735-ab3a-47e2-ba0b-da265882f652 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.860771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6735-ab3a-47e2-ba0b-da265882f652 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.861054 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6735-ab3a-47e2-ba0b-da265882f652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.878284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-89bd6735-ab3a-47e2-ba0b-da265882f652 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:54.879565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-89bd6735-ab3a-47e2-ba0b-da265882f652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:54.915562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc3ba3-03dc-4087-9d0b-0c8930be82d9 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:54.951098 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:54.951900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.952185 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.952459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.953147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 349/700] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:54.954559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b53ea-1372-4d2d-a919-b8aa66797e49 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.954888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b53ea-1372-4d2d-a919-b8aa66797e49 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.955174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b53ea-1372-4d2d-a919-b8aa66797e49 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:54.956576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 350/701] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:54.959523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b53ea-1372-4d2d-a919-b8aa66797e49 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:54.973999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:54.975803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d1eb379c-db91-481b-8190-e37a339b951d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:54.995522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:54.996564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:54.997530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:54.997530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:54.997530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:54.997530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:54.997530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 352/702] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:54.998306 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:54.998727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:54.998856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.016125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:55.017213 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:55.040554 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.076073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.087751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 353/703] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:55.088837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.090520 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b53ea-1372-4d2d-a919-b8aa66797e49 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.139619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.141240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.141539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.141886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.142762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=68b6190e55004134ac73b357fa14abe6) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.143085 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.144523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.150803 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 351/704] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:54 2022] GET /identity/v3/role_assignments?user.id=68b6190e55004134ac73b357fa14abe6&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.159757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.215936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368a2b-5f6f-40bc-a55e-af09a725da60 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.261433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.262285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.262580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.263088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.263778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.265197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:55.286539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:55.287852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:11:55.288973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:55.292687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 354/705] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:55.293850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.327364 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485b1c-da12-4e25-ae2f-3ee7cb3b1d68 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.354549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.362656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.376601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.377289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.378089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.378376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.379433 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.379749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.382109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.401575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 352/706] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.402492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.419202 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4981dbc-b238-4f19-83c8-4f5658c12ae7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.468028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.469782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.470212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.470489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.483519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.484761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:55.506007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:55.507069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 355/707] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:55.508413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.526095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066b7c1-6190-4f65-9af1-05ab6062b8cb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.562990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.563621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.563977 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.564277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.564969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.565274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.566774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.572368 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 353/708] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.573178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.630988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.631396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d492a-c166-4fa2-a4f6-04978f60e056 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.642656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.670636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.671498 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.671776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.672054 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.679573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.681062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:11:55.701769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:55.702987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:11:55.704188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:55.707208 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 356/709] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:55.708327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.708801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2e06-b69a-4a95-a0e0-32f801148300 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.744823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.745682 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.746067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.746474 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.747389 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.747800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.749273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.766998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 354/710] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.768257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.845808 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c288bc1-7a58-456c-9a63-e35340192ebb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.882576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.883472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.883859 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.884264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.885105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.885518 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.886207 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495267-5bcb-4382-87a3-4f19eef7645b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:55.887204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.888209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.898845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 357/711] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.904457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:55.958124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310897b-7697-407b-84bc-190865075a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:55.958890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310897b-7697-407b-84bc-190865075a94 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.959125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310897b-7697-407b-84bc-190865075a94 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.959398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310897b-7697-407b-84bc-190865075a94 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.960226 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310897b-7697-407b-84bc-190865075a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:55.960543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310897b-7697-407b-84bc-190865075a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:55.962077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310897b-7697-407b-84bc-190865075a94 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:55.970034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:55.983110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 355/712] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:55.984565 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea643a0-c882-48e9-ad5f-7a6ee0c60875 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:55.984896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea643a0-c882-48e9-ad5f-7a6ee0c60875 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:55.985668 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea643a0-c882-48e9-ad5f-7a6ee0c60875 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:55.990854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 356/713] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:55.991815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea643a0-c882-48e9-ad5f-7a6ee0c60875 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:56.067332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb0a4-8fd7-4867-b759-cfa87c2f8e79 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:56.106382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:56.107196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.107579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.107953 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.108779 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:56.110436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e6e0-20dc-4153-9bd0-c9665bc5f335 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:56.122496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea643a0-c882-48e9-ad5f-7a6ee0c60875 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:56.137156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 358/714] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:11:55 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:11:56.138669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.139087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.139377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.157578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:56.158879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:56.205499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:56.206203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.206718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.207006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.208187 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:56.208187 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:56.209643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:56.232569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 357/715] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:11:55 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:56.246104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 359/716] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:56.269404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:56.323175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:56.433828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c702168-4e29-4fa6-959c-4382d7be0e92 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:56.472721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:56.476566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.476566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.476566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.476566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:56.476566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:56.497021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:56.498136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:56.499116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 358/717] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:11:56 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:56.505104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:56.526802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:56.623269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524bcc-9c66-4e22-961e-11cf235d6be8 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:56.661355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:56.662438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.662976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.663492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.664425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:56.664981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:56.666603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36e42-3ce4-4682-b171-7aa0ee42b4f2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:56.672229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 360/718] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:11:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:56.677592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:56.785647 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:56.795084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4e1a-d50a-4c0b-b98c-e046d2c215d0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:56.851411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:56.852106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:56.852447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:56.852729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:56.853463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] RBAC: Adding query filter params (type=network) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:56.853775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:56.855203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f172-ff6d-46fd-87dc-40b28642fea6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:56.861500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 359/719] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:11:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:58.015166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad24ed-9320-48eb-8224-cfc994e60df2 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.016205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad24ed-9320-48eb-8224-cfc994e60df2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.016720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad24ed-9320-48eb-8224-cfc994e60df2 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.018568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 361/720] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:58.024241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.025100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.025577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.051699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:58.052907 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:58.148398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 360/721] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:58.179907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad24ed-9320-48eb-8224-cfc994e60df2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:58.288544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:58.310618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad24ed-9320-48eb-8224-cfc994e60df2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:58.354169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:58.355012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.355299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.355577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.384001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:58.392138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:58.393198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:58.394114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 362/722] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:58.401322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:58.514549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:58.530494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd398ab-392d-4197-94d5-57b8fc047d79 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:58.570262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:58.570934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.571227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.571505 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.572286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:58.572590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:58.573977 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269381db-1c71-47d7-afed-4fb6d75afdc7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:58.583163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 361/723] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:58.588726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:58.650618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6801009-ea5f-48ee-bbfc-bcb13b66f685 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.650982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6801009-ea5f-48ee-bbfc-bcb13b66f685 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.651205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6801009-ea5f-48ee-bbfc-bcb13b66f685 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.652717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 362/724] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:58.657866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.658149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.658422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.677603 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:58.678825 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:58.734391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e5272-dc7e-45a4-8514-70f24fc6d6a4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:58.770648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:58.771508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.771791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.772071 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.784380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:58.785864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:58.787889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:58.805683 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 363/725] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:11:58.806933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:58.808051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:58.808998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:11:58.808998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:11:58.808998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:11:58.808998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:58.811082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 363/726] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:58.816690 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:58.836003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:58.936187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5b8a4-76e3-4d3b-bcbd-88c64763f270 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:58.970484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:58.971197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:58.971480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:58.971759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:58.972515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:58.974262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795b23-b509-4081-b5a5-e9961f2bac7f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:58.985508 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:58.990909 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 364/727] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:11:58 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:11:59.048478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213304-8e6b-4fbb-bbbe-290097de7f6e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.097834 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21bd7f-0067-43dd-8297-6bc71a8530f9 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.098760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21bd7f-0067-43dd-8297-6bc71a8530f9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.098857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21bd7f-0067-43dd-8297-6bc71a8530f9 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.101971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 365/728] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:11:59.108856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.109258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.109631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.133505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:59.134967 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:59.151667 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.152669 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.153157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.153587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.154516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:59.155009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:59.156636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:59.192805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 364/729] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:11:59.203797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.207077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.251807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 366/730] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:59.283871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.334699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3034d-3618-4fac-874e-7aa7f1560695 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.368883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.375826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.377489 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.377607 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.377833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.389155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:59.390618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:59.400791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c61e68-9f20-402d-a826-0090396aee38 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-eb11d7eb-e3eb-4382-9daf-3f91aa26f273 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:11:59.406957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:59.408040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:59.409033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 365/731] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:59.410181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40c52-9fec-458d-b016-cc13b8a0f92d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.410424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40c52-9fec-458d-b016-cc13b8a0f92d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.418240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40c52-9fec-458d-b016-cc13b8a0f92d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.418240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 366/732] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:59.418240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce40c52-9fec-458d-b016-cc13b8a0f92d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.450279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.451216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.451558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.452009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.463865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-1cc00875-9ed9-4b35-8726-5693ae069b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:59.473805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:59.474951 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 367/733] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:59.476175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.476953 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.476953 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.497030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:59.499053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:59.553012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.568336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce40c52-9fec-458d-b016-cc13b8a0f92d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.588895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 368/734] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:59.590131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.613971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.614658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.614968 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.615241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.616260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:59.616571 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:59.618713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b215-474c-4247-8d4d-2894b33614ae None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:59.639841 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 367/735] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:59.645645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db45550-2940-47d0-9779-b0b2bcb86e53 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.645937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db45550-2940-47d0-9779-b0b2bcb86e53 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.646212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db45550-2940-47d0-9779-b0b2bcb86e53 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.647662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 368/736] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:11:59.648183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db45550-2940-47d0-9779-b0b2bcb86e53 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.697995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6643b8-01a0-4a41-843b-b991bd874c76 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.701842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.733832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.734509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.734851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.735128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.735898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:11:59.736205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:59.737584 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:11:59.750542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 369/737] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:11:59.750542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.761619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db45550-2940-47d0-9779-b0b2bcb86e53 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.785818 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.800905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.802299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.802584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.802941 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.817032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-38e1e7cf-6198-4d08-804c-17b30113e8f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:11:59.825079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:11:59.826087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:11:59.827414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:11:59.831005 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 369/738] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:11:59.832870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.833172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.833460 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.850597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:11:59.851843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:11:59.854133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0324d-ddcb-49ad-88ef-1e98f9124f4c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:11:59.893401 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:11:59.893990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:11:59.894277 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:11:59.894553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:11:59.920753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 370/739] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:11:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:11:59.921452 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:11:59.970737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:11:59.974980 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:11:59.976470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.013210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.032675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3102-0ae5-48e1-aa4a-8d77c6ef67e4 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.072742 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.073559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.073848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.074124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.085200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 370/740] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:12:00.085200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.089945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.091461 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:00.110374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:00.111540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 371/741] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:00.112481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.196021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28eafc-3ab4-49d4-9119-f4177714159c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.211017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.220005 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099c64-9c2c-46e1-be46-9e117ee6d540 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.233975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.234659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.234976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.235454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.236016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:00.236328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.237713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.240352 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.253175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 371/742] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:00.253175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.256498 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.257232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.257534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.257812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.258579 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.259998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.274972 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 372/743] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:00 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:00.276034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.389415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6d71-6942-4b78-9c52-46ecd5ee85bd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.396246 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13512baf-2512-405e-9f3f-77caa2ca1180 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.430671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.432155 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.432739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.433308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.433659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.434369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.434633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.434949 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.435711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:00.436023 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.437446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.448057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.449924 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.455617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 373/744] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:00.456599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.468926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:00.472789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:00.474496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:00.475472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:00.475472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:00.475472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.475472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:00.478123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 372/745] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:00.483069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.557489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.570601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d15d4-f177-43fe-9f8a-0c0776dd946f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.609998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.610990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.611339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.611679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.622532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.624125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.626350 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205683-010e-4c89-aa9b-b5b80dfc5d8e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:00.643583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:00.644604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:00.645553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:00.645553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:00.645553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:00.645553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:00.649641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 374/746] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:00.650563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.672021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.673676 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.674144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.674900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.688994 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.690697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:00.705571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:00.706611 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:00.707644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 373/747] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:00.708258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.728385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.779245 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada136c-fb02-41be-8cb7-e71a3fcdfa94 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.824837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89994738-3603-4721-89e2-a3c35707b9c7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.825823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.826513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.826829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.827106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.828118 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:00.828430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.830843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.838276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:00.848035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 375/748] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:00.849331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.866423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:00.867512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:00.868040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:00.868532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:00.869567 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:00.870089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:00.871812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:00.890438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 374/749] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:00.891736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:00.969381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509d87-8b56-4d74-88da-657670dc17de None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:00.993753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.009747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.010952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.011453 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.011940 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.013029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:01.013577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.015274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.026185 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec41f-a0d7-4f55-9396-0ff71b7a6a7b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.043064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 376/750] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:01.044051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.063685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.065049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.065582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.066085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.073977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.075881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:01.091174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:01.092156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:01.093129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:01.095805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 375/751] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:01.097159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.132708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.152819 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb6d1d-ac54-4e76-aa02-7c58fe0c6fa1 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.189338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.190176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.190463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.190769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.199213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.200593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.212301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145a60-128b-4500-b573-1d53cba88f7b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:01.217256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:01.218303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:01.219367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:01.223249 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 377/752] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:01.224770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.253824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.254995 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.255534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.256145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.268056 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.269232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.271092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:01.291361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:01.292519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:01.293467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:01.293467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:01.293467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:01.293467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:01.296068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 376/753] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:01.297239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.347080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff321f-c38d-456f-87ad-453765b6449e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.385379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.386061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.386403 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.386711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.387788 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:01.388003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.389424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.391900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.404350 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 378/754] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:01.405639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.412536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e4f1-4200-432e-bc47-c5a1c94ea301 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.447427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.448226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.448608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.448962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.449903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:01.450287 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.452115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.474841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 377/755] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:01.474841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.520202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.524622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4d101-b13a-4c3a-88ed-833560806c29 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.563892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.564582 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.564866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.565140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.565887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:01.566196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.567602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.584761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 379/756] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:01.585491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.587917 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f546-8cce-454c-bac3-8fe955569fe2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.625492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.626164 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.626451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.626778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.627646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=68b6190e55004134ac73b357fa14abe6) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:01.627970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.629412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66f52-1aa2-4c4e-8ee1-0e8880552e87 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.635327 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 378/757] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/role_assignments?user.id=68b6190e55004134ac73b357fa14abe6&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:01.636728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4f9c-ec74-47a4-9d23-3af001816290 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.637017 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4f9c-ec74-47a4-9d23-3af001816290 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.637294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f4f9c-ec74-47a4-9d23-3af001816290 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.642722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 379/758] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:01.642722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f4f9c-ec74-47a4-9d23-3af001816290 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:01.646794 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.718382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee6281-e68d-400b-80ad-cc76257d7b57 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.757849 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.758930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.759416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.759877 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.776973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f4f9c-ec74-47a4-9d23-3af001816290 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:01.792168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.820295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:01.821570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.822112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.822582 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.831565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.833505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.845229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:01.846712 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e359d7c7-9e56-486a-9fde-42e5176c5365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:01.850667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:01.852191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 380/759] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1469b-392d-467b-8740-662b19f5849a None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:01.853276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1469b-392d-467b-8740-662b19f5849a None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:01.853925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1469b-392d-467b-8740-662b19f5849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:01.870140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-2da1469b-392d-467b-8740-662b19f5849a None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:01.871374 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-2da1469b-392d-467b-8740-662b19f5849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:01.934190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:01.950710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 381/760] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:01.950710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1469b-392d-467b-8740-662b19f5849a None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.002415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 380/761] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:02.003686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.056782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1469b-392d-467b-8740-662b19f5849a None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.083261 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.093983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.094830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.095130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.095415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.096499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:02.096629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.098082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.112602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 382/762] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:02.113462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.139666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce768d-de9c-496d-bda8-c7bc6a47c58f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.177750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.197385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.198275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.198568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.198895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.199612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.201029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:02.219438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:02.220555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:02.221519 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:02.230107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 381/763] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:02.230107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.245827 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda8c9-f462-493d-bfa0-7d768f10fd91 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.281313 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.282180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.282569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.282853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.294111 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.295624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:02.313590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:02.314678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:02.315696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:02.315696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:02.315696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:02.315696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:02.315696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 383/764] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:02.316002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.346703 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10fd38-c1e5-42d8-b1ff-55727c5d20df None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.372264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.386726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.388054 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.388570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.389055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/3d4222f61d774512b154900643156352` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.391532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=c7e4a6850d01483b9f9c5ceabd562d91, role_id=3d4222f61d774512b154900643156352)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.393268 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.410924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 382/765] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:02 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:12:02.411674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.433390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331dab-d5af-4ba7-841c-f5ea0ee2c493 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.446547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.489638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.491610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.492131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.493047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.494678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:02.495809 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.498795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.506780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 384/766] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:02.513598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.572387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebb51d-0c56-4232-a676-d3f0e8d936eb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.640459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.641969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.643089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.643619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.644857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:02.645383 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.648262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e56d09-ec29-4beb-b7db-77781ced7eee None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.666167 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 383/767] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:02.667582 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecf9-4173-48e9-9275-c0b618725b16 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.667878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecf9-4173-48e9-9275-c0b618725b16 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.668158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecf9-4173-48e9-9275-c0b618725b16 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.669665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 384/768] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:02.675577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ecf9-4173-48e9-9275-c0b618725b16 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.686452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce4246-e47b-4b56-b493-5d7f1981fcc6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.726395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.729685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.730813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.731300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.731655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.732399 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:02.732715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.734552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49efeb-13f5-4121-914a-6a71f7006329 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.741688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 385/769] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:02.743521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.743820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.744374 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.766225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:02.767848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:02.786020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ecf9-4173-48e9-9275-c0b618725b16 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.799598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.821660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.822710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.823042 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.823423 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.830534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:02.832153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:02.845805 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 386/770] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:02.846496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:02.847673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:02.849150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:02.849718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.855441 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 385/771] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:02.856686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:02.954427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dc3a3-e07d-43c5-bc6c-4a9310ed70d4 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.962618 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9093f-e6ef-4bd6-9bf3-50218a2a9b5b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:02.972245 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:02.997262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:02.997950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:02.998235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:02.998513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:02.999642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] RBAC: Adding query filter params (interface=public, service_id=cf55d5d5cdc34cf2923b31e106cac283, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:02.999960 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.002066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.005871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.006981 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.007339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.007688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.008632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:03.009022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.010540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.011741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 387/772] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/endpoints?service_id=cf55d5d5cdc34cf2923b31e106cac283&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.013117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.029477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 386/773] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:03.029477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.059087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:03.149200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bc620-3b19-4281-9c99-d251064a6416 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.149447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2c38-443a-42c1-a79b-3403daee131b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.190541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.191168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.191397 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.191688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.191971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] PATH_INFO: `/v3/services/network` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.192491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.192647 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.193124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.193544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.194048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.194539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.196314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.202713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 387/774] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.204335 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:03.216659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:03.218027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:03.219184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:03.227222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 388/775] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:03.239894 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.274333 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:03.396987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:03.408629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180389d5-1620-4df9-9df1-a698e6c9a016 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.437073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d14ac-6029-47aa-b978-aeda72262b1f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.450926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.451616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.451902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.452179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.452923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] RBAC: Adding query filter params (name=network) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:03.453242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.454648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.461643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 389/776] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.471793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.490597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.491377 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.491732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.492080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.493076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2cff1cdd1d524aca9d5752de40205a22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:03.493463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.495087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.501380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 388/777] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/role_assignments?user.id=2cff1cdd1d524aca9d5752de40205a22&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.632557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bcfaa-28e6-497d-b5d1-15a0aa5d154f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.669340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.669936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.670220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.670492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.671261 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] RBAC: Adding query filter params (type=network) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:03.671571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.673031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.678827 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 390/778] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.684185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.834090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:03.846623 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94323ef4-72d5-4407-8149-c6892b91beeb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:03.908011 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:03.909052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:03.909560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:03.910066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:03.911106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] RBAC: Adding query filter params (interface=public, service_id=fc1e7af76e3f4779b8ea289b8d3c8330, region_id=RegionOne) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:03.918705 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:03.920398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3442a6-001e-4b5b-9ad2-66ee86545958 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:03.934578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 389/779] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/endpoints?service_id=fc1e7af76e3f4779b8ea289b8d3c8330&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:03.941036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:03.978159 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:04.123432 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562397d2-19e3-40ae-80db-68ba519efa4d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:04.192122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:04.193231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.193739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.194238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.195205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:04.197003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370575c-5a87-479d-9693-eea6d4b5be25 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:04.211183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 391/780] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:03 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:04.443880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ead45-e5f6-4ac2-b55b-425b2ae3bc11 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.444420 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ead45-e5f6-4ac2-b55b-425b2ae3bc11 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.444420 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ead45-e5f6-4ac2-b55b-425b2ae3bc11 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.445789 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 390/781] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:04.453721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.453721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.453721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.478474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:04.479795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:04.566499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 392/782] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:04.589973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ead45-e5f6-4ac2-b55b-425b2ae3bc11 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:04.746457 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ead45-e5f6-4ac2-b55b-425b2ae3bc11 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:04.792885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:04.793709 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.793996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.794265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.810419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-e9fcb320-6be0-49ae-81ad-5a8548cb4d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:04.818186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:04.819229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:04.820145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 391/783] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:04.825632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:04.851082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:04.890364 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56f5f-1a5c-4d21-8334-09aac8c80203 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.890720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56f5f-1a5c-4d21-8334-09aac8c80203 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.890963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc56f5f-1a5c-4d21-8334-09aac8c80203 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.892597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 392/784] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:04.899957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.900243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.900523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.926535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:04.927792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:04.950835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:04.959854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f807b-a9c7-4846-ad7e-0e60aaab88cc None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:04.994855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:04.995562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:04.997454 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:04.997677 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:04.998464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:04.998812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.000215 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.009449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 393/785] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:05.015141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.095058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:05.122893 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231aa9-0a66-44cb-8541-cc98e9e9d985 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.123225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 393/786] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:05.161154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.162020 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.162309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.162583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.167751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.174388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.175911 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:05.194273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:05.195283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:05.196330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:05.196330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:05.196330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:05.196330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:05.196330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 394/787] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:05.202040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.318655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47a63-2955-4e1a-adf8-940318644930 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.347242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:05.359636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.361515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.361803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.362081 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.368847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:05.369194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.370617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.394886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 395/788] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:05.400502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.425513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e4ba2-a379-4c24-9419-a137cbf63fc1 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.512492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa34b8-3e3c-45bf-b6cd-1fb7d9a5d461 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.514559 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.515399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.515681 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.515956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.548062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.548872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.549157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.549437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.550767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:05.556945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.558405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:05.558598 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:05.559610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:05.560553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:05.566820 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 394/789] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:05.571945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.576073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:05.592524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:05.594802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:05.597087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 396/790] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:05.601520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.711090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:05.781830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38defd-497d-4762-aba4-e5ad03805830 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.809408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b182a-4cb5-41bb-a910-eae0e31927b6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:05.851861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.852791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.853085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.853368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.854244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:05.854557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.855390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:05.856061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.856174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:05.856353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:05.856629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:05.857399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:05.857819 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:05.859341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:05.876422 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 397/791] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:05.878271 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 395/792] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:05.884965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:05.885463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.000014 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c74f2-b5bb-41ec-bfa3-68b3a6a5f2f3 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.015096 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.030937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.040642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.041456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.041742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.042021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.052675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.054172 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:06.072510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:06.073502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:06.074469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:06.074469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:06.074469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:06.074469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:06.074469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 398/793] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:06.079541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.091674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf25517-5778-4e9f-9e7d-f4a00959802a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.176988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.177812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.178097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.178376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.199083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.200679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.208184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15195bc-0623-46d3-8ae6-831735af5918 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d00cc846-b75b-48f3-8ff1-30da81ea37d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:06.225277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:06.226330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:06.227359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:06.227359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:06.227359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:06.227359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:06.227359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 396/794] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:06.229107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee986df-0217-4a8c-b45c-c8bcdbbab654 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.229393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee986df-0217-4a8c-b45c-c8bcdbbab654 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.229669 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee986df-0217-4a8c-b45c-c8bcdbbab654 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.234769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 397/795] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:06.235680 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee986df-0217-4a8c-b45c-c8bcdbbab654 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.250854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.251542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.251830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.252109 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.252856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:06.253259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.255033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942868f8-4e78-4f17-a03e-4173b90404d6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.267537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 399/796] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:06.273362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.273659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.274027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.291807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:06.293011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:06.307143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.374764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 400/797] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:06.374764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.383380 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee986df-0217-4a8c-b45c-c8bcdbbab654 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.407731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.429196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.431066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.431663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.432446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.433944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:06.434643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.436628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.456035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 398/798] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:06.456035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.498759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d075-e07f-49c4-b2b8-35add169dd54 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.537095 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.538604 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.539069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.539537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] PATH_INFO: `/v3/users/nova` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.546957 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.548574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.556119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de978-cfe0-47b1-8fa1-032806054eca None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-5b87238d-dd6a-45ad-828b-7d226d4c360d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:06.564445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:06.565632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:06.566898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 401/799] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37ff0-02de-4fff-819b-7e4a5cd9da27 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37ff0-02de-4fff-819b-7e4a5cd9da27 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37ff0-02de-4fff-819b-7e4a5cd9da27 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 402/800] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:06.572728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37ff0-02de-4fff-819b-7e4a5cd9da27 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.583828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.604055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.604885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.605172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.605449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.606155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.607583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:06.620467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:06.621691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:06.627445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 399/801] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:06.628387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.680448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.694899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37ff0-02de-4fff-819b-7e4a5cd9da27 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.734435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.735222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.735509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.735780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.742861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.743394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb626c4-e93d-4520-a5cf-8fef20485fbc None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.744362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-a51f56d3-fa49-4923-a876-a833bb87fe85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:06.758437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:06.759459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:06.760417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 403/802] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:06.760936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.761684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.761684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.779140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:06.780380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:06.784812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.785509 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.785799 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.786064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.786974 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:06.787290 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.788777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.808951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 400/803] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:06.809807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.854119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.860290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 404/804] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:06.861278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.923277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:06.927079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88d0f-79f4-4f92-b420-7eb63ac0dec8 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:06.964680 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:06.965276 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:06.965570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:06.965846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:06.966574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:06.966912 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:06.968294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:06.972994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 401/805] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:06.974088 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:06.980147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f5394-2123-4469-a941-89b5444c1a30 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.013679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.014364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.014627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.014909 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.015723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:07.016035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.017482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.029047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 405/806] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:07.029838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.075327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51880d1-0476-4f48-a3c1-c54dfc549634 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.089579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.111406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.112063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.112343 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.112621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.134320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f62a2-8a62-48c9-9cb3-f082c0d09ed2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.143255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.167864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.168665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.168944 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.169222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.179357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:07.180540 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.182012 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2414374b-4ace-448f-ac7e-9065484529f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:07.187194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:07.188363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:07.189298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 406/807] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:07.190081 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941425f-ef0b-424e-80c4-f96910d36c8f None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.190081 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941425f-ef0b-424e-80c4-f96910d36c8f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.190222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941425f-ef0b-424e-80c4-f96910d36c8f None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.191656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 407/808] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:07.192162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941425f-ef0b-424e-80c4-f96910d36c8f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.283345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 402/809] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:07.284067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.291605 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941425f-ef0b-424e-80c4-f96910d36c8f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.308814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.327376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.328044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.328368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.328639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.329357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:07.329667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.331076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.335890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 408/810] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:07.336729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.351370 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.388759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f136dc7-a74d-455e-93b4-98de39099fc9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.420878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.421777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.422051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.422319 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/68b6190e55004134ac73b357fa14abe6/roles/3d4222f61d774512b154900643156352` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.424280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=68b6190e55004134ac73b357fa14abe6, role_id=3d4222f61d774512b154900643156352)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.425707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942921ae-2a81-482a-8b44-817615c9ec59 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.436343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336cb96-5ca9-41c8-a250-80baf575dfb4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.438201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 403/811] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:07 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/68b6190e55004134ac73b357fa14abe6/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:12:07.439545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.439833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.440106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.468670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:07.471325 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:07.480526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.481229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.481514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.481790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.482571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:07.482916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.484332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.495892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 409/812] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:07.497739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.554921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.568417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 404/813] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:07.570018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.631292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca794693-1221-4536-b35a-28200275e8bb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.632233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.672716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.673532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.673821 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.674100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.681061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46559154-2af0-4a56-aaeb-79159a6f4678 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.684965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.686435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:07.703710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:07.704760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 410/814] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:07.705732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.722140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.722855 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.723154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.723741 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.724574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.725965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.748415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 405/815] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:07.749160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.828349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.838621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8743f-f6da-4fa5-b974-0431d6406587 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.877391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd485f2-2350-4a76-8d49-e4286c721742 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:07.882262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.883351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.883636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.883913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.887659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:07.901434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.903275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.920923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:07.921903 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:07.922263 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:07.922831 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] PATH_INFO: `/v3/services/network` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:07.923665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:07.925174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:07.926166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:07.927196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:07.928150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:07.928150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:07.928150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:07.928150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:07.930696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 411/816] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:07.931906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:07.939345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:07.940486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:12:07.941430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:07.946284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 406/817] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:07.948111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.068430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecb61-ff9e-4f67-b7e5-6dfb0dfc896c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.085964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfd004-b5b7-4e74-9041-f0f344edd989 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.113250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.114300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.114656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.115028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.116116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.116495 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.118736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.129176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.130117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.130605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.131229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.131828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.132141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.133589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.142451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 412/818] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.143694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.149256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 407/819] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.150164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.155491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.185736 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.249600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed542b5-54d5-49a8-96c6-4cbb68f30113 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.263584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5116-b399-4d94-93f9-2088cadad784 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.286919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.287553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.287928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.288298 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.289120 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] RBAC: Adding query filter params (name=network) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.289589 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.291115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.296020 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 413/820] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.296915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.303602 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.304692 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.305165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.305613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.313833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.316010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:08.331495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:08.332503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:08.333463 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:08.336058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 408/821] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:08.337161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.381687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.416406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b5e2-3c8a-4149-95ff-6f20f1d3c86f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.451751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.452690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.453033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.453368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.461462 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.464177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.479893 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:08.480908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:08.482791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 414/822] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:08.484748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.506079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cf621-6c88-4589-8ccc-eefafc83c1c3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.567918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.569625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.571231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.572132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.573869 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] RBAC: Adding query filter params (type=network) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.574673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.577784 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.588992 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 409/823] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.590842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.591544 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b287d1-9735-433f-8150-e8355798afb3 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.634364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.642850 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.643927 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.644760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.645303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.646661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.647224 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.649026 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.662542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 415/824] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.663685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.727575 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085f508-8ea7-4649-9749-4a5cf53081da None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.763007 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.763684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.763966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.764237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.765094 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:08.765404 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.766866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.775490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aba814-58df-4e7d-9256-4dccebae410c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.785495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 410/825] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:08.786330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.804224 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.815554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:08.816649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:08.817211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:08.817800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:08.818982 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:08.820762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:08.843269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 416/826] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:08.844587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:08.905408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:08.968758 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604690e-7db4-4f02-b151-5f6cbb62788a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:08.968980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8f5c-723f-4e52-bd67-6059d0309a7d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:09.013832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.015101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.015496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.015882 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.028209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.030537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:09.056085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:09.057176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:09.058142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:09.058142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:09.058142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:09.058142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:09.058381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 417/827] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:09.063736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:09.084178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.084857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.085145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.085415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.086313 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:09.086658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.088188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.100255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 411/828] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:08 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:09.179024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:09.186296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330136dd-c4d2-4588-bab4-e844037aef4b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:09.225459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.226144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.226423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.226711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.227513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:09.227820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.229208 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.243604 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 418/829] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:09.248943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:09.347381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:09.373252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3cc65-b734-496f-b9f2-089b6b202710 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:09.408764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.409907 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.410368 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.410834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.418134 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.419651 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:09.434328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:09.435417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:09.436391 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 412/830] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:09.443824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:09.547446 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462d152-3d86-433c-bf1a-112a6fef1977 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:09.581747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.582558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.582873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.583152 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.583961 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:09.584271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.585730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992589fd-f125-47d2-b02b-9a525b22d4d7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.602799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 419/831] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:09.605156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:09.718442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915170d-151d-4e5b-9a3b-1ed726d27778 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:09.759001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f174ca-7834-4210-a911-901912749360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:09.760287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f174ca-7834-4210-a911-901912749360 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.760782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f174ca-7834-4210-a911-901912749360 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.761291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f174ca-7834-4210-a911-901912749360 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2cff1cdd1d524aca9d5752de40205a22/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.765939 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:09.779957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f174ca-7834-4210-a911-901912749360 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=2cff1cdd1d524aca9d5752de40205a22, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:09.781445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f174ca-7834-4210-a911-901912749360 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:09.796620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 413/832] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:09 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2cff1cdd1d524aca9d5752de40205a22/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:12:09.879868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7bca-0909-4833-ae19-6d21c7d051ef None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.880258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7bca-0909-4833-ae19-6d21c7d051ef None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.880426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c7bca-0909-4833-ae19-6d21c7d051ef None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.882116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 420/833] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:09.887968 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:09.888255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:09.888546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:09.910369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:09.912026 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:09.990880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 414/834] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:10.014254 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c7bca-0909-4833-ae19-6d21c7d051ef None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.036948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.128460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c7bca-0909-4833-ae19-6d21c7d051ef None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.164001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.165198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.165723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.166234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.177469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9d6a5a16-76f2-4bbf-b4dc-f3806b47568b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:10.185701 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:10.186719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:10.187628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:10.190516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 421/835] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:10.196161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.224236 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a362ba-637c-4da2-a14a-c72dbc3796f7 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.224881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a362ba-637c-4da2-a14a-c72dbc3796f7 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.225426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a362ba-637c-4da2-a14a-c72dbc3796f7 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.227358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 422/836] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:10.232815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.233099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.233376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.258137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:10.259735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:10.315978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc374bd8-a398-4a8e-b834-22accea2d42f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.341605 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 423/837] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:10.347046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.361320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.362043 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.362604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.363643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.363995 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.365004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:10.365597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.367375 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.372414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.377934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 415/838] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:10.386733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.474140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a69d6-a40b-47ff-a482-a3090613dd23 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.489865 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231eda7-9321-451e-81ed-d52bc3f1ef31 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.526677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.527495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.527776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.528048 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.528593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.529651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.530425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.531344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.532226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.533820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.540351 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.541785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:10.549635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:10.550777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:10.551754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:10.554783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 424/839] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:10.558050 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:10.566466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:10.567684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:10.568890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:10.568890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:10.568890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:10.568890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:10.570806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 416/840] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:10.575905 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.609445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.640742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.673996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802912-2ff4-4d0a-ab45-a3b51bd05415 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.688203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fcb14-1805-4b74-91d0-fe6444c67043 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.709357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.710033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.710319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.710596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.711527 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:10.711901 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.713406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.725541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 425/841] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:10.726713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.736636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.737320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.737603 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.737915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.739270 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:10.739596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.740989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.761672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 417/842] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:10.763132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:10.851139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214a15-3184-41f5-94cf-f0e2094652df None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.874004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.886922 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d825d00-0a2e-4630-add4-a04cedb390d7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:10.898360 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.899548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.900039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.900538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.901465 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:10.901973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.903598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.905160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:10.915127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 426/843] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:10.932153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:10.932989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:10.933270 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:10.933549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:10.942606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:10.944157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:10.961074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:10.962309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:10.963348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 418/844] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:10.970183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.088815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd9c4a-9259-4462-8e49-f67688ddd875 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:11.128533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:11.129585 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.130069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.130542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.131757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:11.132351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:11.134191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:11.154251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 427/845] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:12:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:11.163868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.268109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258a94b-e6d1-48ff-9ef9-52aeab54cf4d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:11.302594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:11.303280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.303569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.303847 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.327028 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:11.379007 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:11.380398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee704d-785e-4b28-a0fb-8630efb37f93 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:11.495106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 419/846] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:11.496830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.550003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd700d2-400d-4ffe-a2b6-746036304a4d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.550352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd700d2-400d-4ffe-a2b6-746036304a4d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.550560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd700d2-400d-4ffe-a2b6-746036304a4d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.552242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 420/847] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:11.559933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.560299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.560650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.561190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:11.581045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:11.582719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:11.608396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c230-294d-4ee2-aa05-1b6850821838 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:11.635138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:11.644177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:11.645040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.645671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.645671 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.656562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:11.658027 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:11.667080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 421/848] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:11.676416 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:11.677482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:11.678437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:11.678437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:11.678437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:11.678437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:11.682338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 428/849] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:11.683774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.689966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.806251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44722704-f38a-4e8c-a921-354c08c48f67 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:11.821602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb153b-72e6-4c98-a746-3f8b77108189 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:11.834176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:11.849801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:11.851209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.851714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.852480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.853574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:11.854076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:11.856222 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:11.866147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:11.867613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:11.867965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:11.868426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:11.869321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:11.870785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:11.875753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 422/850] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:11.877859 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:11.888748 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:11.889915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:11.891532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:11.894796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 429/851] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:11.897003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:11.939275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.012388 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fed-05fa-4f9f-b062-e19a13b982d7 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.033006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106e4b7-ba44-43e2-b504-90e3072329ca None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.056029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.056864 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.057144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.057424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.066185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.068191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.076528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.077683 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.078177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.078733 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.079681 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:12.080202 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.081899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39384f-de23-44fd-af09-b22b92b2ad9a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8759aad7-bbe4-429c-a0de-c01672458e2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:12.085053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:12.086295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:12.087314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 423/852] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:12.088019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be87f3-9742-4a23-a2f5-3d14231898dd None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.088309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be87f3-9742-4a23-a2f5-3d14231898dd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.088593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be87f3-9742-4a23-a2f5-3d14231898dd None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.090089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 424/853] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:12.096355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be87f3-9742-4a23-a2f5-3d14231898dd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.096642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 430/854] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:12.098156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.098803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.099084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.117394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:12.118594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:12.150247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.190797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 431/855] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:12.192001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.212003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.218340 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be87f3-9742-4a23-a2f5-3d14231898dd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.259282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.259963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.260252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.260539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.261332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:12.261649 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.263131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.280051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 425/856] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:12.281051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.300280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb3265-54a8-4e72-a770-abdf0d3b36f5 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.338943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.339634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.339921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.340195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.340930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:12.341242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.342872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.350320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 432/857] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:12.350620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.385936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.418473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8422-ba5c-466e-9db5-66b9019ac333 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.461512 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.462770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.463258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.464346 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.480240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe9dba-ea54-4575-b979-9612e7096d3e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.480501 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:12.492396 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:12.493569 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:12:12.494454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:12.501164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 426/858] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:12.501945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.529144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.542068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.542779 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.543075 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.543351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.544248 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=68b6190e55004134ac73b357fa14abe6) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:12.545459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.547028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.554552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 433/859] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/role_assignments?user.id=68b6190e55004134ac73b357fa14abe6&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:12.629552 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27938d80-4a8e-4808-a8e1-e1ccca6d9fd3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.681363 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.682002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.682334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.682607 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.683698 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:12.684096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.685632 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.696475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 427/860] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:12.702425 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.811639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:12.818617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655b6ad-eb3f-4372-88c9-de0e70bc7e87 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:12.854727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:12.855563 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:12.855848 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:12.856128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:12.867689 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:12.869170 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:12.887188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:12.888295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:12.890016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:12.890016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:12.890016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:12.890016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:12.890016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 434/861] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:12.894427 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:12.984254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.003078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19955-c7f1-420f-ba26-06de3cd2a253 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.037209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.037881 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.038209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.038485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.039256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:13.039597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.040993 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9886e-cb91-458a-b875-8eea5c5a1a95 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.055148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 428/862] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:13.060717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:13.171860 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b59f58-e1f0-42ee-b37b-98f2db119396 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.207357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.208182 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.208472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.208750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.217009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.218480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:13.234116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:13.235275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:13.236340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 435/863] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:13.243535 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc684-a331-4a9d-a206-2f756ef31b7b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.243810 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc684-a331-4a9d-a206-2f756ef31b7b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.244090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc684-a331-4a9d-a206-2f756ef31b7b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.244394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:13.245733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 429/864] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:13.254079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.254515 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.254828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.258786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.271417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:13.272604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:13.340376 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 430/865] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:13.360063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6784df-9aa6-4696-95ab-d453a31210d0 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.362628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:13.395194 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.396168 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.396722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.397167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.398273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:13.398799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.400434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.419659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 436/866] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:13.430717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:13.439067 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.471474 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc3869-ad50-4bb2-aafd-3558e2f3d62f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.488089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.511853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.512884 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.513393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.513873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.514962 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.516551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.527356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a7c7-23c1-4696-ba51-cfd6aa05a2e0 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.546650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 431/867] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:13 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:13.582379 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.583377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.583871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.584304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.665107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.666936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.735258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.779520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 437/868] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:13 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:12:13.784963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:13.890494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5031ab-be85-4b46-93b3-2a2db027bf67 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:13.921138 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:13.926641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:13.927493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:13.927775 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:13.928051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:13.939069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:13.940580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:13.959244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:13.960264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:13.961426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:13.961426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:13.961426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:13.961426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:13.961426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 432/869] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:13.966167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:14.080921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71628c11-de4b-46a8-b777-3bd268062010 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:14.119029 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:14.119714 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.120000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.120277 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.121090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:14.121400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:14.122822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:14.137802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 438/870] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:14.143516 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:14.247086 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca07d-a26d-4e96-9eb0-22eb32e430b9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:14.282399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:14.283240 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.283524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.283800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.290713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:14.292168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:14.306163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:14.308070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:14.310022 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 433/871] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:14.316070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:14.341133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:14.430113 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4273e-8dbf-4258-87b2-d90b508306bf None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:14.465473 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:14.466160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.466430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.466722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.467548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:14.467858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:14.469343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a7f5c-9e61-4e9e-8550-dd790a14c3d6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:14.484400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 439/872] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:14.490503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:14.541457 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:14.604100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf6c5b-bde9-4f7f-afd2-347093ee6fbc None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:14.638537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:14.639236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.639518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.639800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.640644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2cff1cdd1d524aca9d5752de40205a22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:14.640956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:14.642398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc262e-94d8-4b3b-bd20-7d31c04451dd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 434/873] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:14 2022] GET /identity/v3/role_assignments?user.id=2cff1cdd1d524aca9d5752de40205a22&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:14.679184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e429ca-bd4c-4bf3-b56a-007bb82d5b91 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.679184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e429ca-bd4c-4bf3-b56a-007bb82d5b91 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.679184 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e429ca-bd4c-4bf3-b56a-007bb82d5b91 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.680143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 440/874] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:14.686172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28f1-abba-4cf0-8f04-cef64da28c43 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.686853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28f1-abba-4cf0-8f04-cef64da28c43 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.687317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd28f1-abba-4cf0-8f04-cef64da28c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.705397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-68dd28f1-abba-4cf0-8f04-cef64da28c43 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:14.707036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-68dd28f1-abba-4cf0-8f04-cef64da28c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:14.793543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 435/875] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:14.816916 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e429ca-bd4c-4bf3-b56a-007bb82d5b91 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:14.910041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cac87-4f69-4d34-847b-e6c536a83c5d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.910388 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cac87-4f69-4d34-847b-e6c536a83c5d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.910678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cac87-4f69-4d34-847b-e6c536a83c5d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.912643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:14.913785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 436/876] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:14.918093 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.918394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.918671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.936404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e429ca-bd4c-4bf3-b56a-007bb82d5b91 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:14.939210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:14.940424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:14.975188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:14.975875 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:14.976158 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:14.976435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:14.977292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:14.978175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:14.978716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:14.997583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 441/877] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:14 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:15.039986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 437/878] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:15.063388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:15.179338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa37b6-e92a-4f67-aa1f-cb515b730931 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:15.217471 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:15.218291 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:15.218570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:15.218889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:15.219553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:15.220926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:15.233361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:15.234459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:15.235456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 442/879] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:15.243273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:15.350277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5864d9-a93e-43e6-bb48-0236ae449900 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:15.385580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:15.386266 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:15.386553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:15.386864 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:15.387595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:15.387906 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:15.389287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7da47-9453-471d-a0bb-b5e527107e28 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:15.394646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 438/880] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:15.400971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:15.406294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:15.516464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa7d89-62eb-4f3f-a450-6f7bdd736e2a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:15.551082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:15.551765 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:15.552051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:15.552326 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:15.553048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:15.553355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:15.554767 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a8b18-e18e-48ed-8fc7-e275bab8aefe None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:15.560136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 443/881] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:15.969583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd3de-ca72-4919-855e-4abb3d132f3d None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:15.970148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd3de-ca72-4919-855e-4abb3d132f3d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:15.970148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd3de-ca72-4919-855e-4abb3d132f3d None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:15.971663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 439/882] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:15.977479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:15.978289 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:15.978810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:15.997509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:15.999183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:16.062284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:16.068163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 444/883] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:16.090439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd3de-ca72-4919-855e-4abb3d132f3d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:16.120050 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:16.199640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd3de-ca72-4919-855e-4abb3d132f3d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:16.236748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:16.237528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:16.237820 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:16.238095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:16.238793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:16.240216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:16.252416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:16.253485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:16.254379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 440/884] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:16.259782 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:16.360195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92650bb4-f778-4de5-bd3e-ff01a428b325 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:16.395132 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:16.396155 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:16.396634 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:16.397097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:16.398009 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:16.398550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:16.400197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:16.405547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 445/885] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:16.411220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:16.507193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:16.516473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466fbb0-3259-487d-99b9-553515402500 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:16.550622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:16.551324 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:16.551605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:16.551880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:16.552604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:16.552916 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:16.554306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:16.559808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 441/886] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:16.565645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:16.629181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:16.668477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbff09-f9c5-43c2-9fb8-b92e55650da7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:16.702935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:16.703600 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:16.703881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:16.704153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:16.704956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] RBAC: Adding query filter params (interface=public, service_id=771f4654e02e440ebac8d32b24f76ba4, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:16.705269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:16.706652 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d022-4f56-4406-868f-46c229ba0083 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:16.712303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 446/887] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:16 2022] GET /identity/v3/endpoints?service_id=771f4654e02e440ebac8d32b24f76ba4&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:16.717697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:16.828834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a02feb-9fc6-4250-80f5-24b63165a281 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:16.864829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:16.865561 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:16.865845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:16.866119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:16.866845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:16.868287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680ece7-6cc9-4961-ad41-2fa135f4bf98 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:16.874742 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 442/888] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:16 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:12:17.141074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d090-0875-4107-be60-3a6bfc3b2d96 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.141606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d090-0875-4107-be60-3a6bfc3b2d96 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.141896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6d090-0875-4107-be60-3a6bfc3b2d96 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.143513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 447/889] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:17.149035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcd1-8f94-4d4c-bfd2-83b851570f13 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.149509 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcd1-8f94-4d4c-bfd2-83b851570f13 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.149706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dcd1-8f94-4d4c-bfd2-83b851570f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.167429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-5061dcd1-8f94-4d4c-bfd2-83b851570f13 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:17.168613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-5061dcd1-8f94-4d4c-bfd2-83b851570f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:17.183670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.245738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 443/890] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:17.269496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d090-0875-4107-be60-3a6bfc3b2d96 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.378516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6d090-0875-4107-be60-3a6bfc3b2d96 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.396215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dd43-f0ab-4b2c-a5b0-f925d976355c None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.396415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dd43-f0ab-4b2c-a5b0-f925d976355c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.396697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615dd43-f0ab-4b2c-a5b0-f925d976355c None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.398318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 444/891] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:17.403545 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.403840 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.404114 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.415167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.416097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.416387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.416666 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.422265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:17.423688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:17.424629 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.429063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:17.444156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:17.445267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:17.446721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 448/892] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:17.454350 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.507853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 445/893] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:17.530145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.572993 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6474c3-a1be-4142-8fe5-464fad29de03 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.609547 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a458-f369-4021-920e-d626c778adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.610639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a458-f369-4021-920e-d626c778adac None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.611219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a458-f369-4021-920e-d626c778adac None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.611713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3a458-f369-4021-920e-d626c778adac None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.612685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3a458-f369-4021-920e-d626c778adac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:17.613220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3a458-f369-4021-920e-d626c778adac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:17.614885 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3a458-f369-4021-920e-d626c778adac None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:17.623979 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 449/894] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:17.632065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a458-f369-4021-920e-d626c778adac None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.634882 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.656979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260760d-f3f9-4310-b863-8694d44acf1e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.681874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.694941 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.695799 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.696083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.696357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.697118 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:17.698586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:17.711923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:17.713208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:17.714609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 446/895] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:17.719013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.744156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3a458-f369-4021-920e-d626c778adac None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.782289 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.783459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.783959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.784434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.799740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:17.801504 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:17.823657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:17.824687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:17.825661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:17.825661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:17.825661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:17.825661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:17.833166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 450/896] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:17.835639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.836933 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805541a-8e12-4bfd-aa57-b6f21bd240d9 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.873650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.874532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.874922 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.875262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.876101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:17.876472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:17.878005 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:17.883919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 447/897] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:17.889162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:17.904714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.960984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:17.964199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271c20-fd82-4102-a40b-fbd75d614807 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:17.997636 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:17.998307 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:17.998586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:17.998889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:17.999654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:17.999958 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.001267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1baa-96e7-4299-b875-4ac61e405eac None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.001394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924562e-7bc9-468a-8437-585c933bd69f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.013181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 451/898] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:18.014540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2e5-27d4-42ff-8c20-494e22c18696 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.014865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2e5-27d4-42ff-8c20-494e22c18696 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.015142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc2e5-27d4-42ff-8c20-494e22c18696 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.016693 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 452/899] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:18.019468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc2e5-27d4-42ff-8c20-494e22c18696 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.046103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.046823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.047126 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.047389 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.048117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:18.048421 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.049798 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253c9a5-b725-4ab8-8893-9b3c3c543bb3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.054737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 448/900] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:18.055960 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.056253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.056530 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.072750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:18.074055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:18.139160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc2e5-27d4-42ff-8c20-494e22c18696 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.152944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 449/901] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:18.152944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.152944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:18.179467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.180536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.181146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.181405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.189431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.190927 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:18.207049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:18.208145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:18.209151 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 453/902] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:18.209790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.233902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:18.276245 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d2eed-f86b-40ff-8c44-46d74a27b690 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.314262 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.314953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.315166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c9d59-90fa-4059-9b71-371a5c9ed508 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.315286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.315497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.316302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] RBAC: Adding query filter params (interface=public, service_id=bb307105778741259eb8b19e8d99c82f, region_id=RegionOne) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:18.316859 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.319093 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.326861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 450/903] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/endpoints?service_id=bb307105778741259eb8b19e8d99c82f&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:18.327800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.355053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.355735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.356219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.356334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.357028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.358411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.372956 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 454/904] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:18 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:18.374589 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.396622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:18.438988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10005b-a47b-4b0e-a45a-dc13f10adb9f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.497239 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.497835 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.498116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.498389 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.499991 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:18.500303 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.502265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.507062 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:18.537737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 451/905] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:18.539159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:18.540692 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c87c2f-7128-4aef-9097-3e9ef9d88739 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.590579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.591294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.591576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.591846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.592545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.593921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.604068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 455/906] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/services => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:12:18.664372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c017-70e7-4faf-bca1-8f485720335c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:18.688418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:18.705484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:18.706222 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:18.706512 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:18.706857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:18.782833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:18.784251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:18.890394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 452/907] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:18.895998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.009837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a0526-3520-4be4-919d-5c3ceffd62f2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.044655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.045391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.045675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.045954 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.057359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.058853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.061487 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-51959fe6-fb61-403d-addb-7a06d1ee4b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:19.076778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:19.077811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:19.078833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:19.078833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:19.078833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:19.078833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:19.084262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 456/908] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:19.090104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.117857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.158247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0905ca-2508-47c5-b69d-8c438309ae91 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.158630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0905ca-2508-47c5-b69d-8c438309ae91 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.158849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0905ca-2508-47c5-b69d-8c438309ae91 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.160543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 457/909] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:19.165872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.166165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.166447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.187735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:19.188934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:19.212196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b085b7-3a4d-4d07-bed4-97497df80d06 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.249763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.250641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.251036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.251627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.252295 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:19.252677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.254128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.267124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 453/910] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:19.269912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 458/911] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:19.276121 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.297938 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.366568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.387851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e06ae-8855-462b-b053-25914415eaa5 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.407380 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b70df-998c-42dc-a0b2-4e3680cc1034 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.424500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.425821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.426338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.426871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.434535 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.434875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.436899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.443898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851893b-063f-4690-b97a-94416165b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.445209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851893b-063f-4690-b97a-94416165b135 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.445549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851893b-063f-4690-b97a-94416165b135 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.445832 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851893b-063f-4690-b97a-94416165b135 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.446509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851893b-063f-4690-b97a-94416165b135 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.447928 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851893b-063f-4690-b97a-94416165b135 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:19.455770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:19.456731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:19.457735 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b851893b-063f-4690-b97a-94416165b135 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:19.460256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:19.461348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:12:19.462245 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:19.463566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 454/913] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:19.465704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.466581 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 459/913] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:19.467865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851893b-063f-4690-b97a-94416165b135 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.575180 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ff86b-9914-45b9-be79-3e345c0f2083 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.575399 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851893b-063f-4690-b97a-94416165b135 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.613794 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.614491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.614796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.615071 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.615801 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:19.616019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.616154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.617017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.617512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.617743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.618228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.619417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:19.619950 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.621643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.627230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 460/914] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:19.628538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.631899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.636137 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 455/915] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:19.642873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.687382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.733819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efa57c-fba9-41a6-af91-dd1ec7eb232c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.752266 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5e06-3cb0-48b6-8eab-550e1adf7648 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.768484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.769165 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.769451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.769728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.770460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:19.770792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.772188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.781973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 461/916] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:19.783190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:19.789722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.790648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.791168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.791626 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.792754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] RBAC: Adding query filter params (role.id=0f030b68909f4c95b9aff414467ff7f0, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2cff1cdd1d524aca9d5752de40205a22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:19.793256 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.794996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3e5aa-6d4a-4a4b-906c-0da6b3560d4e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.801154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 456/917] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:19 2022] GET /identity/v3/role_assignments?user.id=2cff1cdd1d524aca9d5752de40205a22&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=0f030b68909f4c95b9aff414467ff7f0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:19.895571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ff0d7-e422-42d9-9643-7c75ecabee9e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:19.917793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:19.933220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:19.933966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:19.934256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:19.934541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:19.935357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:19.936770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a06d-0b6c-47d5-a6e8-a1cfcf4d2fcf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:19.966900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 462/918] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:20.694187 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274b54-c854-41da-94b4-fd14e3f7901b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:20.694787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274b54-c854-41da-94b4-fd14e3f7901b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:20.694787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274b54-c854-41da-94b4-fd14e3f7901b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:20.696424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 457/919] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:20.701927 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:20.702345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:20.702524 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:20.719372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:20.720545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:20.796922 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 463/920] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:20.819014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274b54-c854-41da-94b4-fd14e3f7901b None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:20.894461 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:20.936478 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274b54-c854-41da-94b4-fd14e3f7901b None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:20.974044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:20.974886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:20.975167 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:20.975439 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:20.976103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:20.977557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c60cccad-df06-4abc-bf41-93cb39c4eacf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:20.989721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:20.990816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:20.991727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 458/921] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:20.999802 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.072190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4956-c077-43a3-a1be-42fbeae2fff3 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.072402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4956-c077-43a3-a1be-42fbeae2fff3 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.072759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b4956-c077-43a3-a1be-42fbeae2fff3 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.074482 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 459/922] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:21.079763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.080120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.080473 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.098255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:21.099898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:21.102118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:21.104860 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06452ff-c591-4866-95f5-2b5db7f0d09e None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.145210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.146333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.146837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.147310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.148227 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:21.148778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.150482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.156461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 464/923] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:21.162409 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.182837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 460/924] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:21.201021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.268419 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:21.270499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471103b-91ad-4512-a3cd-13cd76b74fe1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.307511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.308572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.309211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.309723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.310744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:21.311267 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.312858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.312983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bd54-4b50-4ee0-90c6-32d89e535c4d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.323093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 465/925] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:21.325094 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.350951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.351871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.352157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.352487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.353200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.354697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.357414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:21.369817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:21.371105 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:12:21.372029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:21.374746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 461/926] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:21.380903 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.435030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51009da-6470-43b2-b911-616673a3b785 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.471674 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.472310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.472658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.473002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.474176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] RBAC: Adding query filter params (interface=public, service_id=5b8b95ea8b614b5c9b44cad43eeba81f, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:21.474533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.475940 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.494728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 466/927] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/endpoints?service_id=5b8b95ea8b614b5c9b44cad43eeba81f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:21.494728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.495038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d229f-eddd-417a-9fcf-e4c9cdfcab74 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.514844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:21.528797 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.529624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.530008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.530382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.531254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:21.532040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.533255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.543034 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 462/928] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:21.544734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.587399 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:21.597036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51baa15c-0c72-4d98-a379-a6bcd1461929 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.634509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.635212 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.635493 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.635923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.636557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.638031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.650817 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 467/929] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:12:21.657348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc87bf9-401b-4141-8b35-cdfb45c2c91b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.696282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.697892 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.698402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.698944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.699902 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:21.700416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.702048 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4c7c1-06be-4c91-bee3-6c50fed8c0e1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.708514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 463/930] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:21.714835 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:21.828141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827986-7e76-4de7-ac0a-a51796af121e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:21.866716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:21.867845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:21.868338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:21.868843 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:21.869827 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:21.871450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c49fd1-fa2c-441b-a9d4-cb5ec76b2d61 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:21.895181 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 468/931] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:22.091499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4345f-51d1-43fb-aad8-1764d0cf81a9 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.092091 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4345f-51d1-43fb-aad8-1764d0cf81a9 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.092374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4345f-51d1-43fb-aad8-1764d0cf81a9 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.094051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 464/932] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:22.100546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd745d-3e4b-4e9a-8dfa-ea0da25025ab None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.101201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd745d-3e4b-4e9a-8dfa-ea0da25025ab None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.101755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd745d-3e4b-4e9a-8dfa-ea0da25025ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.121495 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9dbd745d-3e4b-4e9a-8dfa-ea0da25025ab None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:22.123085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9dbd745d-3e4b-4e9a-8dfa-ea0da25025ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:22.131774 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.202507 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 469/933] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:22.225965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4345f-51d1-43fb-aad8-1764d0cf81a9 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.277937 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6a596-80d7-4cd3-a1db-9870f7e9d33a None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.278238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6a596-80d7-4cd3-a1db-9870f7e9d33a None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.278525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6a596-80d7-4cd3-a1db-9870f7e9d33a None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.280853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.281289 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 470/934] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:22.285393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.285686 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.286015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.306082 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:22.307385 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:22.337993 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4345f-51d1-43fb-aad8-1764d0cf81a9 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.372577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.373670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.373957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.374236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.389873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:22.400402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:22.401773 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:22.402890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 465/936] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:22.403731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 471/936] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:22.405813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.428936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.519279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.542349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7e23-f46a-4944-9114-949381e60503 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.557016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.573350 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c5c5-ebc8-4b9f-b914-1fcb7d89b3e1 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.583522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.584149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.584441 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.584719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.585496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:22.585805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:22.587353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:22.596889 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 466/937] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:22.602444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.616075 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.617100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.617644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.618143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.619129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:22.620814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:22.622429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: WARNING keystone.server.flask.common [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:12:22.641452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.sql.core [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:12:22.641452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:12:22.641452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [parameters: {'id': '1ef5dde701684f2ea1e6167e06d36a5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:12:22.641452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ef5dde701684f2ea1e6167e06d36a5d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ef5dde701684f2ea1e6167e06d36a5d. May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:12:22.650513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 20:12:22.651438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application yield resource May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise self.value May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application session.commit() May 19 20:12:22.652513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.flush() May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application compat.raise_( May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:12:22.653488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:12:22.655301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:12:22.657275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [parameters: {'id': '1ef5dde701684f2ea1e6167e06d36a5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.659514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:22.661474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ef5dde701684f2ea1e6167e06d36a5d. May 19 20:12:22.664305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.670840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 472/938] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 20:12:22 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:22.673786 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.715591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf059be-146d-4dcd-9529-f9afc9b9df7a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.760557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.761932 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.762947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.763409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.777608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:22.780056 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:22.803036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bc2c4-dbe8-41ad-b989-c923300f5072 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:22.804112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:22.805264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:22.806255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:22.806255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:22.806255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:22.806255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:22.809408 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 467/939] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:22.814586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.843434 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.848135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:22.872742 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.873566 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.873852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.874128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.886620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:22.888761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:22.909392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:22.910398 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:22.911412 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:22.914539 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 473/940] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:22.924696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:22.941220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250544b-6f76-4010-9953-f86b28ca895a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:22.979219 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:22.979904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:22.980190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:22.980465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:22.981677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:22.981677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:22.983146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.001450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 468/941] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:23.002413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.031023 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c435e9e-ec50-426d-b7bc-96ed0203f25d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.065904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.066993 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.067586 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.068073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.069039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:23.069546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.071270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.092846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:23.098906 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 474/942] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:23.113071 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6d092-926b-488a-b35d-5f929923fdaa None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.154110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.155356 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.155878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.156305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.166095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.168074 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:23.186160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:23.187525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:23.188807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:23.191285 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 469/943] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:23.197438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.248052 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:23.319451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd100b-5dac-43e4-a975-b93985d50093 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.357242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.357935 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.358228 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.358509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.359403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:23.359721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.361176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.379630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 475/944] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:23.385275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.500612 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2fb57-3987-409a-b2b3-ca1e55f63073 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.537467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.539456 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.540279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.541158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.556014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.557854 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.560992 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:23.579702 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:23.580733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:23.581704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:23.581704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:23.581704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:23.581704 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:23.584129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 470/945] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:23.590128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.697385 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959aa09-7a39-4d53-80bb-a91b7e667802 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.699093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:23.735269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.735868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.736158 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.736440 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.737189 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:23.737503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.738929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.752700 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 476/946] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:23.758779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.869079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1dc1d-3cac-47f6-b2e1-c79c2efec122 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:23.904999 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:23.905822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.906108 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.906387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.913639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:23.915246 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4a91e349-c713-4399-9335-d518e0abbd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:23.929395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:23.930424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:23.931434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 471/947] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:23.939829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:23.945131 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b1cc1-232c-4171-b2a0-5286cd9ed7f1 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.945486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b1cc1-232c-4171-b2a0-5286cd9ed7f1 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.945772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b1cc1-232c-4171-b2a0-5286cd9ed7f1 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.947432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 472/948] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:23.952706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:23.952991 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:23.953268 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:23.972794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:23.975157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:24.046306 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.071014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 473/949] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:24.087078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590e162-c31c-4802-86a7-e7b4d69b089d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.100711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.128572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.129776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.130276 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.130795 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.131873 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:24.132410 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.134221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.149180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 477/950] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:24.157886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.181265 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.215444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486b7df-aa2d-48dd-8028-bb248e5e27c9 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.254785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.255621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.255907 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.256174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.256855 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.258283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.263755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c0709-177a-4030-b7d1-0bc8d4bd4d5c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:24.272089 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:24.273165 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:24.274140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 474/951] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:24.281874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.301525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.302324 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.302613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.302926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2cff1cdd1d524aca9d5752de40205a22/roles/0f030b68909f4c95b9aff414467ff7f0` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.305507 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=2cff1cdd1d524aca9d5752de40205a22, role_id=0f030b68909f4c95b9aff414467ff7f0)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.306949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f4589-2b6b-4623-9c85-b1dc44ec9788 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.324680 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 478/952] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:24 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/2cff1cdd1d524aca9d5752de40205a22/roles/0f030b68909f4c95b9aff414467ff7f0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:12:24.359111 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.374926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d33e-f9a7-4c47-9b8c-993b3d177eb6 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.375211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d33e-f9a7-4c47-9b8c-993b3d177eb6 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.375491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d33e-f9a7-4c47-9b8c-993b3d177eb6 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.381344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 479/953] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:24.382780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.383106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.383393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.404269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:24.406663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:24.408537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf567231-e3cb-4721-9cf3-3a7800ada83e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.457925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.460911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.461338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.462884 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.463641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:24.463956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.465381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.480319 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 475/954] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:24.485964 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.513332 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 480/955] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:24.537372 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.556484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.615193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf73c80-e15c-4e97-950c-2901006b8196 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.630666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.654582 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.655430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.655777 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.656164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.656955 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:24.657325 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.658787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.665343 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 476/956] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:24.668684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dafaf6-3f70-4910-9ec7-7b1c3c44ea62 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.671302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.714001 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.715503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.716910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.717394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.718302 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.719936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:24.736053 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:24.737283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:24.738177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:24.743030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 481/957] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:24.747227 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.807457 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45fb7-6069-4c1c-81b0-23f2f292461c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.847428 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:24.852059 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.853016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.853302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.853578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.854342 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.856080 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.878992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e593a5c-0dff-4b76-8969-7eb446705b44 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:24.890727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 477/958] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:24.940552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:24.941278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:24.941523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:24.941804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:24.942538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:24.942884 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:24.944299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608c9a5-73c1-4197-aa4a-99bb364de9d1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:24.950815 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 482/959] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:24.956547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:24.997721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:25.082951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfd717-bb4a-42f9-9753-2d989ecbc48f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:25.121142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:25.122122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:25.122458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:25.122782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:25.123547 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:25.123804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:25.125181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26100aa9-8f17-47d3-a667-23ea521051b9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:25.130190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 478/960] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:25.566867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199169e-e6d3-4524-b4a9-93883bdd955a None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:25.567231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199169e-e6d3-4524-b4a9-93883bdd955a None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:25.567431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199169e-e6d3-4524-b4a9-93883bdd955a None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:25.569098 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 483/961] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:25.574593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:25.574962 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:25.575255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:25.592706 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:25.593972 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:25.667213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 479/962] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:25.693041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199169e-e6d3-4524-b4a9-93883bdd955a None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:25.800338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199169e-e6d3-4524-b4a9-93883bdd955a None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:25.835258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:25.835996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:25.836288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:25.836569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:25.837294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:25.838767 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:25.851180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:25.853330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.sql.core [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:12:25.853330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:12:25.853330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [parameters: {'user_id': 'b9e1df1ac8db4cf7aa83b6239c9fa504', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:12:25.853330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:12:25.862388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:12:25.863702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application yield resource May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application next(self.gen) May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise self.value May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application session.commit() May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:12:25.865235 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.session.flush() May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application compat.raise_( May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:12:25.866191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:12:25.867187 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application conn.query(q) May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application result.read() May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:12:25.868175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9e1df1ac8db4cf7aa83b6239c9fa504', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:25.869084 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 20:12:25.869948 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:25.876458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 484/963] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:12:25 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:25.877283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:25.899146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:25.970475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2629-e38e-4f10-bb54-8886d95ba850 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:26.009273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:26.010098 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:26.010387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:26.010669 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:26.018205 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:26.019700 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-0ff60dcf-809f-45bf-a1bb-9422fc326b7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:26.034510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:26.036839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:12:26.039158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:26.046731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 480/964] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:26.046904 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:26.146252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa40ff7-489a-475b-9739-531bd1e9430c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:26.181366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:26.182054 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:26.182334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:26.182607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:26.183456 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:26.183817 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:26.185467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f975e0e-3b5d-48db-bfeb-0d881578501d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:26.224484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 485/965] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:12:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:26.689657 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633137-fd39-418c-aa8e-9042aec45790 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:26.690058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633137-fd39-418c-aa8e-9042aec45790 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:26.690188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633137-fd39-418c-aa8e-9042aec45790 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:26.691710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 481/966] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:26.697542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:26.697836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:26.698107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:26.715685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:26.717177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:26.771776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:26.789403 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 486/967] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:26.813378 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633137-fd39-418c-aa8e-9042aec45790 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:26.907921 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:26.927971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633137-fd39-418c-aa8e-9042aec45790 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:26.964457 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:26.965298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:26.965583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:26.965858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:26.977460 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:26.985900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:26.987254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:26.988182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 482/968] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:26.995243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.111134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168ab1-371a-4a5e-a3b3-aec1cc423c4f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.145824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.146510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.146822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.147099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.147866 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:27.148172 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.149653 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18d9a7-7c20-4028-b123-9be6b7bb0f4a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.158347 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 487/969] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:27.164400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.245816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961f55-ed55-499f-8172-d0e615c686d2 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.246107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961f55-ed55-499f-8172-d0e615c686d2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.246394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de961f55-ed55-499f-8172-d0e615c686d2 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.247892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 488/970] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:27.253908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.254249 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.254472 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.271688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:27.272871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:27.273983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8093-61d7-4280-8e77-a6486fd545a2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.311670 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.312506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.312792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.313069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.320520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.327588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.329157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.338676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.345867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 489/971] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:27.350436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:27.351639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:27.352611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:27.352611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:27.352611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:27.352611 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:27.356362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 483/972] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:27.357672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.371677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.458999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f7265-51b2-45e5-b4c9-800c0c441ca5 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.477178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33466990-525c-4f5e-a484-e1d7e4da6392 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.494414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.495127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.495411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.495685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.496423 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:27.496729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.498107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d9c8-70cb-49e6-81a3-e65bbecaaf7f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.509381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 490/973] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:27.510610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1bee-406f-4b61-848a-5d27f580619b None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.510937 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1bee-406f-4b61-848a-5d27f580619b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.511216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1bee-406f-4b61-848a-5d27f580619b None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.512467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 491/974] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:27.515005 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1bee-406f-4b61-848a-5d27f580619b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.515381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.516128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.516563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.516738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.517400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.518791 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-bc05ac37-d6cb-404b-8895-a84946ced740 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:27.534963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:27.536232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:27.542435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 484/975] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:27.543352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852337-709c-4a26-993c-cad46415edbd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.543352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852337-709c-4a26-993c-cad46415edbd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.543352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9852337-709c-4a26-993c-cad46415edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.554898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.555204 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-a9852337-709c-4a26-993c-cad46415edbd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:27.556406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-a9852337-709c-4a26-993c-cad46415edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:27.615194 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.616625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1bee-406f-4b61-848a-5d27f580619b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.624014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 485/976] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:27.624568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9852337-709c-4a26-993c-cad46415edbd None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.652579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.653407 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.653694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.653973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.661197 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.662649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:27.677669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:27.678706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 492/977] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:27.679757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.728232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9852337-709c-4a26-993c-cad46415edbd None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.763531 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.764252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.764538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.764809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.765527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:27.765833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.767241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.772052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 486/978] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:27.773106 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.777557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.781565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f553c-a111-43ce-8629-619b3414ae3e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.815736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.816508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.816791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.817065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.817799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.819210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.833099 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 493/979] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:27 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:27.833661 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:27.833881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.894495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770892d9-8866-447e-9552-fa9c739e308a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.940171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:27.941101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:27.941305 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:27.941604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:27.942479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:27.942817 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:27.944283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:27.952424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ccc50-afa2-4da2-9e8f-9c35c1a0f027 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:27.964468 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 487/980] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:27.970392 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:27.999716 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.000741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.001161 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.001572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.002308 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:28.002792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.004949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.016620 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 494/981] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:28.018778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.047504 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.084243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff2a-9d9f-4eef-b3dd-1ee44b181139 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.097809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.122820 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.123479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.123764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.124290 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.133140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e606759-3be8-4450-ae12-5a41d7e1046b None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.169020 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.169593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.169872 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.170148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.170977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b8b95ea8b614b5c9b44cad43eeba81f, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:28.171288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.172659 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.178283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 495/982] 10.222.0.77 () {56 vars in 1249 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/endpoints?service_id=5b8b95ea8b614b5c9b44cad43eeba81f&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:28.183632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.196017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.197488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.271338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.290477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee985a7-aa2d-436b-bb88-bc7a731394f9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.304971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 488/983] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:27 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:12:28.310487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.324839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.329247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.330031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.330309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.330580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.331300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.332784 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.339846 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 496/984] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:12:28.423568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c1266-fd28-4314-ab21-8888850f477c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.462781 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.463963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.464451 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.464930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.479310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.480801 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:28.500666 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:28.501878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:28.503367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:28.503367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:28.503367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:28.503367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:28.506767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 489/985] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:28.508186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.617512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eb4a0-b3d7-4829-81e6-fd9618d98dbd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.652996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.653831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.654217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.654587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.655460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:28.655865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.657341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.670771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 497/986] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:28.676297 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.743786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.782650 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebda10e-2f51-48f1-87a8-d0ab357fc8da None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.820308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.821120 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.821402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.821673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.828604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:28.830068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:28.843926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:28.844888 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:28.845891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:28.850729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 490/987] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:28.851362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:28.864376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:28.957318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e881-67aa-4bae-8beb-f9de4a8bf803 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:28.996077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:28.997173 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:28.997689 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:28.998179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:28.999262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:28.999811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:29.001525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801dac5-663c-4600-b1e7-271a3b9d338b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:29.014307 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 498/988] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:29.020640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:29.128321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cec61-4b9f-4df5-80f8-40b3a4a28463 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:29.153128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:29.164857 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:29.165527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:29.165815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:29.166092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:29.166969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] RBAC: Adding query filter params (role.id=0f030b68909f4c95b9aff414467ff7f0, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=2cff1cdd1d524aca9d5752de40205a22) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:29.167285 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:29.168726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7a883-2498-42d6-bb1c-8a71a8c99a8b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:29.175148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 491/989] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:29 2022] GET /identity/v3/role_assignments?user.id=2cff1cdd1d524aca9d5752de40205a22&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=0f030b68909f4c95b9aff414467ff7f0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:30.090889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fba0-2209-411f-8a22-c609c95de439 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.091516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fba0-2209-411f-8a22-c609c95de439 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.091837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fba0-2209-411f-8a22-c609c95de439 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.095092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 499/990] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:30.103895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.104407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.104407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.124251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:30.125454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:30.193762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 492/991] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:30.216722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71fba0-2209-411f-8a22-c609c95de439 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.291344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:30.326325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71fba0-2209-411f-8a22-c609c95de439 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.362607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:30.363360 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.363643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.363912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.364578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:30.365962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:30.378200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:30.379339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:30.385514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 500/992] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:30.388422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.506663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43249d-2ab5-4363-88f1-ea0013e6f4e9 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.525544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:30.543929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:30.544613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.544898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.545176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.545899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] RBAC: Adding query filter params (name=compute) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:30.546211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:30.547635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e993c-dcf8-421e-9320-77dab996ee21 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:30.552836 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 493/993] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:30.558673 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.580337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3bf9-612a-4428-9770-20f3a068ca03 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.580642 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3bf9-612a-4428-9770-20f3a068ca03 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.580898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3bf9-612a-4428-9770-20f3a068ca03 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.582714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 494/994] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:30.587653 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.587911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.588210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.605802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:30.607399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:30.667934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d947c18-6993-4909-97ba-36f456e8f9d3 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.677912 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 495/995] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:30.700698 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.703024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:30.703694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.703974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.704246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.704964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] RBAC: Adding query filter params (type=compute) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:30.705270 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:30.706638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:30.708090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:30.713619 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 501/996] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:30.719090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.807746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20706b8-6c19-4aff-bded-6e2007c2b95c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.822900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:30.826225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e28d46-6c2a-4ed0-92a0-8f07f8368cee None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.847390 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:30.848223 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.848821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.849118 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.849774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:30.851750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:30.864183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:30.865233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:30.866164 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 496/997] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:30.867077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:30.867711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:30.867711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:30.868003 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:30.868816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] RBAC: Adding query filter params (interface=public, service_id=cddee7b4018546b399ea39888627781a, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:30.869218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:30.870870 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:30.872582 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.878991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 502/998] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/endpoints?service_id=cddee7b4018546b399ea39888627781a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:30.884992 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:30.949100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:30.990341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c9083-9976-438f-9c88-c291fbac503c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:30.993280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296004dd-09e5-41d2-99d4-9d4907bdd731 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:31.025763 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.026902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.027389 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.027844 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.028697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.030033 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.030417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.030732 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.031028 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.031308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.032107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:31.032341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.033710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.038565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 503/999] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:12:31.043630 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 497/1000] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:31.044880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:31.157660 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3a84-ea62-4012-9b47-bb36d0f6cd56 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:31.185635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:31.196231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.196908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.197206 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.197466 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.198202 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:31.198513 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.200004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847ccf-80f5-48c1-80ff-a251bd5cc7dc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.205915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 504/1001] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:12:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:31.211844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:31.263613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:31.324157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117687a9-d177-4c63-a0e5-5315a9e26135 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:31.361526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.362197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.362480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.362792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.363558 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.364937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa541fa9-c8ad-428d-be5f-d60380a51816 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.380924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 498/1002] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:31.422069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e47d-fc25-4c4e-94ba-b4168214a2a6 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.422413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e47d-fc25-4c4e-94ba-b4168214a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.422643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115e47d-fc25-4c4e-94ba-b4168214a2a6 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.424258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 505/1003] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:31.430281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.430587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.430911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.450252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:31.451440 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:31.552823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 499/1004] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:31.575107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e47d-fc25-4c4e-94ba-b4168214a2a6 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:31.679234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115e47d-fc25-4c4e-94ba-b4168214a2a6 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:31.712479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.713206 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.713489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.713764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] PATH_INFO: `/v3/services/image` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.714429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.715841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:31.728115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:31.729250 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:31.730811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 506/1005] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:12:31 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:31.735322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:31.763136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:31.841815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4395f5b-9492-4676-a573-8c473e64c8ee None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:31.876578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:31.877420 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:31.877804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:31.878178 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:31.879039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] RBAC: Adding query filter params (name=image) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:31.879447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:31.880920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be710-f38f-4786-8450-542df99b7cde None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:31.886236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 500/1006] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:31.891820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:31.949537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:31.997353 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9195c-9483-4c62-ae6f-c5dfbd63ffb2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:32.033007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:32.033803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:32.034179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:32.034552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:32.035515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] RBAC: Adding query filter params (type=image) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:32.035918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:32.037376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e6f3-d034-4849-b10b-8503e15b2cc5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:32.042451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 507/1007] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:33.286676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5470-9d52-496b-81bb-a259b84e2914 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.287237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5470-9d52-496b-81bb-a259b84e2914 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.287322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5470-9d52-496b-81bb-a259b84e2914 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.288672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 501/1008] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:33.294244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.294678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.294895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.312090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:33.313313 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:33.385628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 508/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:33.408483 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5470-9d52-496b-81bb-a259b84e2914 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:33.516077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:33.528643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5470-9d52-496b-81bb-a259b84e2914 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:33.564393 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:33.565115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.565402 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.565681 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] PATH_INFO: `/v3/services/compute` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.566342 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:33.567753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-079b8467-942e-40df-b59b-c33477584b20 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:33.579874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:33.580936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:12:33.582064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:33.586355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 502/1010] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:33.587275 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:33.637119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:33.643965 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154197-1dad-45b5-98e9-d4882a98c271 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.644251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154197-1dad-45b5-98e9-d4882a98c271 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.644533 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd154197-1dad-45b5-98e9-d4882a98c271 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.645926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 503/1011] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:33.651211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.651501 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.651808 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.668667 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:33.669872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:33.695528 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64236b8-3f7f-42f9-9b5a-47329521e2b5 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:33.738076 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:33.739079 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.739521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.740021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 504/1012] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:33.740214 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.741019 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:33.741338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:33.742847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:33.751153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 509/1013] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:33.757139 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:33.762639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:33.852623 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:33.872430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8defa-9094-4091-9433-80060b3e976a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:33.875438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6c4e-f9e4-4a51-b087-a62f75034f23 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:33.889560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:33.911218 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:33.912013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.912323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:33.912442 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.912626 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.913133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:33.913510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:33.913622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:33.913792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:33.913951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:33.915085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:33.915372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:33.916520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:33.918390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 510/1014] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:33.925534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 505/1015] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:12:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:33.925695 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:33.926128 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:34.029294 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587208d1-4d20-4b9e-a978-c14529852ff1 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:34.045460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e59e06-b94f-4aeb-8b49-76a641ddd564 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:34.066900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:34.067590 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:34.067875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:34.068159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:34.068937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:34.070403 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd030ee-9fa0-4db5-8894-7e7f00d59b6c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:34.084321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:34.084905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:34.085191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:34.085482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:34.086386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:34.087921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0567a3-f9bf-4b48-b838-ae23dc3f23dc None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:34.102804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 506/1016] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:34.127367 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 511/1017] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:33 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:34.266177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c6fc-0382-42c3-8864-27cc6cdcf6b0 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:34.266462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c6fc-0382-42c3-8864-27cc6cdcf6b0 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:34.266762 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c6fc-0382-42c3-8864-27cc6cdcf6b0 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:34.268216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 507/1018] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:34.274549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d066-7c8d-4e83-9a5c-83b51d8be9f1 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:34.274881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d066-7c8d-4e83-9a5c-83b51d8be9f1 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:34.275167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04d066-7c8d-4e83-9a5c-83b51d8be9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:34.293987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-1e04d066-7c8d-4e83-9a5c-83b51d8be9f1 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:34.295272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-1e04d066-7c8d-4e83-9a5c-83b51d8be9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:34.327188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:34.379819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 512/1019] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:34 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:34.402980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c6fc-0382-42c3-8864-27cc6cdcf6b0 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:34.407044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:34.516945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c6fc-0382-42c3-8864-27cc6cdcf6b0 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:34.552941 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:34.553614 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:34.553904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:34.554177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:34.555001 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:34.556381 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6beb8-8ad9-42c8-96b3-84191a45f02d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:34.571920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 508/1020] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:12:34 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:12:36.414307 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8325e7-b95d-4aac-972e-8138835be739 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.414942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8325e7-b95d-4aac-972e-8138835be739 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.414942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8325e7-b95d-4aac-972e-8138835be739 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.416417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 513/1021] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:36.421738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.422192 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.422276 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.440314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:36.441587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:36.454991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2c62-54ca-439f-84e9-c07ae6ef08a5 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.455300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2c62-54ca-439f-84e9-c07ae6ef08a5 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.455558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c2c62-54ca-439f-84e9-c07ae6ef08a5 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.457108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 514/1022] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:36.462067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.462359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.462624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.486160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:36.487431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:36.516361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:36.534749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 509/1023] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:36.563957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:36.572294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 515/1024] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:36.596299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:36.674500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d87a1-5444-49e6-9493-9d29a771b072 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:36.690538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:36.704057 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2a640-3c2a-43d4-b94c-da0cf1ab4057 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:36.709998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:36.710870 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.711159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.711435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.712645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:36.714101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:36.718746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 510/1025] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:36.721352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:36.743668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:36.744503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.744789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.745069 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.755546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:36.763874 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:36.764886 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:36.765793 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 516/1026] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:36.771195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:36.790057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:36.831150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4c516-32b8-40d2-9a6e-09c10ec264a5 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:36.865438 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:36.866117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.866399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.866675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.867455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:36.868887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb40db3-215b-4124-a9a2-c3cde0529414 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:36.871302 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3fd52-b340-4003-a032-9cfd8672e00a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:36.890082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 511/1027] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:12:36 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:36.893415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3948c-8b9f-45b5-83be-ec6a4a980e3b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.893715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3948c-8b9f-45b5-83be-ec6a4a980e3b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.894005 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3948c-8b9f-45b5-83be-ec6a4a980e3b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.895724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 512/1028] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:36.903021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.903514 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.904006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.917148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:36.917883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:36.918145 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:36.918424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:36.919300 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:36.919612 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:36.921055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:36.924578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:36.925871 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:36.930794 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 517/1029] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:36.936896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:36.952101 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.018576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 513/1030] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:37.034101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.056309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505acb4-ff08-4fe0-9912-5596eb40965a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.095415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.097417 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.098814 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.099106 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.099388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.115609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.117163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:37.137575 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:37.138602 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:37.140377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:37.140377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:37.140377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:37.140377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:37.145378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 518/1031] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:37.151033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.166638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93ae26-2b18-4696-be05-b1afcedb2029 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.209825 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.211228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.211748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.212227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] PATH_INFO: `/v3/services/image` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.213122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.214749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.222031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:37.228031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:37.229109 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:37.230018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:37.232367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 514/1032] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:37.238202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.269824 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c196c0-92c4-4cd6-86a6-bdc8035d12fe None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.306220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.306902 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.307182 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.307459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.308205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:37.308508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.310239 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.323910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 519/1033] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:37.329536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.340860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85eac4-2e58-4a5d-98d6-69a3d786912e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.351841 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.381136 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.381967 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.382357 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.382901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.383652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] RBAC: Adding query filter params (name=image) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:37.384065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.385517 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.391119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 515/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:37.396369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.445562 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e01d-75d7-4cfe-8ebf-f21e8994e22e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.473639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.486302 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.487150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.487430 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.487727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.495134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.496587 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.505768 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58066-5592-4200-8942-269ffc9fda3f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:37.511490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:37.512500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:37.513550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 520/1035] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:37.518457 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.547943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.548725 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.549014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.549287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.550021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] RBAC: Adding query filter params (type=image) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:37.550334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.551787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.556923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 516/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:37.562764 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.599568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.633282 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376373f4-a191-4276-9c02-a4faedb273f5 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.670605 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.671321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.671609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.671888 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.672757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:37.672879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3f3b6-beea-422b-a1ce-db8e353d850f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.673073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.674519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.692757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 521/1037] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:37.698579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.709115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.710024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.710309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.710588 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.711564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] RBAC: Adding query filter params (interface=public, service_id=60da817835db42e98590a912bb962480, region_id=RegionOne) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:37.711906 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.713281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.718723 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 517/1038] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/endpoints?service_id=60da817835db42e98590a912bb962480&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:37.724462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:37.747594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.812887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c316c-dba5-4eb8-b11c-ed36707b87a2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.827711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:37.831839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8936ba3-8700-400c-af90-196c022df952 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:37.850073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.851049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.851370 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.851654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.867289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:37.868211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:37.868496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:37.868774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:37.869583 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.871107 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.886727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 518/1039] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:12:37.936870 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:37.938376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:37.984641 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:38.050580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 522/1040] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:12:38.056161 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:38.163499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ff35-907e-43e8-8ffc-973e5e251222 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:38.201314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:38.202126 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:38.202415 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:38.202701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:38.213848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:38.215336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:38.240429 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:38.241418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:38.242462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:38.242462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:38.242462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:38.242462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:38.242462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 519/1041] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:38.248861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:38.351237 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8462c86-7e7e-466d-ad8c-49f0bd49931d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:38.385354 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:38.386033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:38.386319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:38.386597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:38.387364 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:38.387675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:38.389060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:38.397538 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:38.404836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 523/1042] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:38.407245 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:38.426360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:38.521839 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b965-6b46-46a2-9fad-820fa8d5cc27 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:38.557155 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:38.558274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:38.558660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:38.559097 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:38.566471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:38.567990 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:38.582596 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:38.583622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:38.585479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 520/1043] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:38.589649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:38.693140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d455-5303-42e1-b1fc-fd4dabe3ae94 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:38.727353 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:38.728028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:38.728310 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:38.728583 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:38.729385 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:38.729695 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:38.731177 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c1f30-ce9a-4b89-af76-516fd6df431d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:38.744171 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 524/1044] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:38.750061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:38.830554 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:38.856169 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717bc9-caea-40b3-8267-59c1e5f94ec4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:38.889787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:38.890448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:38.890771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:38.891043 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:38.891890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] RBAC: Adding query filter params (role.id=0f030b68909f4c95b9aff414467ff7f0, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:38.892203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:38.893652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406880e-2322-442d-ab21-a301743d7961 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:38.899708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 521/1045] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:38 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=0f030b68909f4c95b9aff414467ff7f0 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:39.191863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fe3f-eb56-4e1e-847a-0bd5feca3918 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.192231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fe3f-eb56-4e1e-847a-0bd5feca3918 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.192424 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140fe3f-eb56-4e1e-847a-0bd5feca3918 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:39.193915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 525/1046] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:39.199711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.199978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.200273 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:39.217843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:39.219051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:39.288038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 522/1047] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:39.311116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140fe3f-eb56-4e1e-847a-0bd5feca3918 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:39.375747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:39.419169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140fe3f-eb56-4e1e-847a-0bd5feca3918 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:39.454768 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:39.455491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.455769 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.456035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:39.466979 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:39.475041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:39.476013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:39.476983 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:39.481406 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 526/1048] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:39.482648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:39.552749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:39.586014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608949c0-6eba-47d9-9e03-7c8392ff8996 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:39.625245 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:39.625935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.626220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.626494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:39.627327 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:39.627600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:39.628989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:39.638157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 523/1049] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:39.643866 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:39.749343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b7ade-dc0f-4a5c-b333-6e0893561f87 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:39.769545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:39.785141 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:39.786024 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.786309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.786585 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] PATH_INFO: `/v3/users/16dc050725e740d7a15968e2e2cf04c9` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:39.800391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] RBAC: Authorizing `identity:get_user(user_id=16dc050725e740d7a15968e2e2cf04c9)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:39.801892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:39.808523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 527/1050] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:39 2022] GET /identity/v3/users/16dc050725e740d7a15968e2e2cf04c9 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:39.809794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:39.914170 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb277a-1e35-4ea6-a281-f4778328e72b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:39.944210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:39.952195 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:39.952896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:39.953181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:39.953459 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.029094 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.030480 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dbc56-c150-4930-b34c-e4a3b7fb5ab0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.130036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 524/1051] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:40.135861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.142220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed6b-d348-4ef2-96c5-ec33fc7be1bf None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.142518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed6b-d348-4ef2-96c5-ec33fc7be1bf None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.142824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed6b-d348-4ef2-96c5-ec33fc7be1bf None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.144372 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 525/1052] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:40.149430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.149718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.149994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.168320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:40.169512 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:40.196271 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:40.243958 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390f967-799d-4f0d-b7e2-560853385e05 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.246833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 526/1053] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:40.267354 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.287648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.288468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.288783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.289070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.290284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.291798 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.293542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 528/1054] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:40 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:40.299657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.348044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:40.374525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871b068-e0ec-47e9-aac9-e34e5a3e5a77 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.405375 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b7616-8ede-432b-a534-ae87c1836480 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.409698 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.410507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.410812 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.411090 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] PATH_INFO: `/v3/services/image` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.411756 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.413199 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:40.425445 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:40.426542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:40.427510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 527/1055] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:12:40 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:40.433257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.445089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.445764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.446052 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.446336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.447231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user.id=16dc050725e740d7a15968e2e2cf04c9) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:40.447546 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.448990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.454939 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 529/1056] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:40 2022] GET /identity/v3/role_assignments?user.id=16dc050725e740d7a15968e2e2cf04c9&scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:40.470027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:40.552493 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d11c-ab9e-4d8c-bebd-8370782d881b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.590289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.591075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.591331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.591560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.592291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] RBAC: Adding query filter params (name=image) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:40.592604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.594024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.600499 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 528/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:40.606319 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.719221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43922b3c-42dd-4af7-8d82-e7c646dc8736 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.730393 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:40.755813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.756498 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.756785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.757063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.757844 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:40.758155 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.759578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9371-e00e-4e9f-b65c-b832064f11e1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.764808 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 530/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:40.770401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:40.866779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:40.877952 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014387ae-11f0-4947-a13f-41d0d22d19ef None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:40.911653 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:40.912347 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:40.912633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:40.912911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:40.913695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:40.915223 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d27a2-18ac-42f4-aec6-ee6dbc141267 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:40.946662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 529/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:12:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:41.119572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d7a3-842d-4802-8ada-4f705dd29339 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.119761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d7a3-842d-4802-8ada-4f705dd29339 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.120171 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d7a3-842d-4802-8ada-4f705dd29339 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.121685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 531/1060] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:41.127328 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.127626 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.127908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.151052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:41.152299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:41.230617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 530/1061] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:41.253041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d7a3-842d-4802-8ada-4f705dd29339 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:41.365083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d7a3-842d-4802-8ada-4f705dd29339 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:41.400960 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:41.401776 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.402058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.402328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.412437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:41.420921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:41.421932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:41.423272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:41.426789 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 532/1062] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:41.428253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:41.508339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:41.540563 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71765bb-be30-483e-979f-21e29c700f55 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:41.578227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:41.579014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.579296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.579566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.580334 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:41.580640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:41.582017 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:41.590972 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 531/1063] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:41.596713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:41.636007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:41.704807 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a0754-2d6f-4686-adf6-8843c7aa0dbd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:41.740712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:41.741511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.741772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.742093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.752408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:41.753999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:41.771631 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:41.772645 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:41.773734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:41.773734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:41.773734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:41.773734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:41.775034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 533/1064] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:41.778630 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:41.882845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130fc4-71a8-4393-a7f8-fe6ef01e9d31 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:41.916761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:41.917427 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:41.917712 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:41.917988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:41.918726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:41.919051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:41.920435 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:41.921862 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:41.934242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 532/1065] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:41.939907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.028070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:42.044679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b97c2-e1d1-4a3d-b4ea-6732e39e4ace None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.079892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.080703 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.080990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.081268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.089764 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.091305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:42.107625 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:42.108731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:42.114662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 534/1066] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:12:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:42.116826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.221100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1bba3-5769-43b3-9039-141c2c2a51ea None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.256159 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.257046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.257336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.257643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.258507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:42.258856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.260308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.278748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 533/1067] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:42.284203 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.399330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf6a7e-b797-465f-a772-3b4701c80aa7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.434550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.435376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.435661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.435941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.446294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.447852 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.454670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:42.472840 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:42.474247 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:42.475331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:42.475331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:42.475331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:42.475331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:42.475331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 535/1068] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:42.477337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.537387 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:42.585688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aedaed-07f2-4758-a031-cfe2169aef6f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.625798 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.626500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.626784 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.627044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.627788 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:42.628093 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.629468 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5a9e-bde3-4de0-a780-5aa711d3807c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.645924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 534/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:42.647226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.685270 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7073e-61dc-440a-a4ec-99bee17824b7 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.685561 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7073e-61dc-440a-a4ec-99bee17824b7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.685842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7073e-61dc-440a-a4ec-99bee17824b7 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.687413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 535/1070] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:42.692259 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058d31-0af3-4941-878c-350bec74e822 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.692664 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058d31-0af3-4941-878c-350bec74e822 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.692949 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058d31-0af3-4941-878c-350bec74e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.712081 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-16058d31-0af3-4941-878c-350bec74e822 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:42.713277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-16058d31-0af3-4941-878c-350bec74e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:42.756729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60142-276d-4f6d-adfb-a486d9feb02d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.793519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.794232 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.794518 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.794816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.794941 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 536/1071] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:42.801685 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.803193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.812006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16058d31-0af3-4941-878c-350bec74e822 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:42.817118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:42.818150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:42.819301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 536/1072] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:42.824066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.864233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:42.888936 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:42.924676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16058d31-0af3-4941-878c-350bec74e822 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.934733 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e257c9-363e-4f36-8bf6-2e30bc1683d4 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:42.958467 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.959314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.959601 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.959878 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.970228 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:42.970470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:42.970921 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:42.971204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:42.971479 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:42.972291 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:42.972596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:42.974362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:42.978638 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:42.979778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:42.983899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 537/1073] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:42.985829 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:42.990817 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 537/1074] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:42.996721 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.101697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ca72a-a63a-4e01-b651-37ec87a9cee9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.101915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc477cf-9014-40b5-ad5f-733f23ecfa26 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.103315 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.122153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.139865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.140828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.141080 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.141318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/0f030b68909f4c95b9aff414467ff7f0` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.143591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=c7e4a6850d01483b9f9c5ceabd562d91, role_id=0f030b68909f4c95b9aff414467ff7f0)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.145039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506e36b-dd17-44af-996b-c79ef787ef14 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.145147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.145738 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.146018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.146291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.147158 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:43.147462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.148943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.158649 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 538/1075] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:43.159595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 538/1076] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:42 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/c7e4a6850d01483b9f9c5ceabd562d91/roles/0f030b68909f4c95b9aff414467ff7f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:12:43.164902 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.216097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96a97-c2c0-4c44-aee7-9a4072cf2ee5 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.216402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96a97-c2c0-4c44-aee7-9a4072cf2ee5 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.216638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee96a97-c2c0-4c44-aee7-9a4072cf2ee5 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.218094 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 539/1077] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:12:43.224756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.225115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.225278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.244496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:43.245756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:43.289275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06058c84-1420-4ca6-b94a-8f58dc8b08ad None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.326595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.327687 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.327971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.328244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] PATH_INFO: `/v3/users/16dc050725e740d7a15968e2e2cf04c9` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.329495 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=16dc050725e740d7a15968e2e2cf04c9)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.330989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.331638 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 540/1078] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:43.337691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 539/1079] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:43 2022] GET /identity/v3/users/16dc050725e740d7a15968e2e2cf04c9 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:43.338565 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.357979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.396639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.445055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673fcb-1d4c-4dad-9437-b2548fe2bdd9 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.454402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.483778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7967d-cb9b-4918-ae00-181f84300ab0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.490854 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.491783 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.492086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.492359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.493553 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.495077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.501626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 541/1080] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:43 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:43.503500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.524671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.525324 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.525608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.525884 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.602162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.603641 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.614761 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23596e8c-13e9-42ec-b13e-14d52113dc1e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.635275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.650785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.651688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.651970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.652244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706/users/16dc050725e740d7a15968e2e2cf04c9/roles/3d4222f61d774512b154900643156352` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.654244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] RBAC: Authorizing `identity:create_grant(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user_id=16dc050725e740d7a15968e2e2cf04c9, role_id=3d4222f61d774512b154900643156352)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.655731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.670627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 542/1081] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:43 2022] PUT /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706/users/16dc050725e740d7a15968e2e2cf04c9/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:12:43.720152 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 540/1082] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:12:43.727083 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:43.770115 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:43.843737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c9b0-5b7b-4e8e-ab29-4de38e6513bb None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:43.881033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:43.881849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:43.882130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:43.882431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:43.893192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:43.894662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-81dc3373-619e-4b6e-93ff-2c5e89ccb30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:43.917635 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:43.919117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:43.920190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:43.920190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:43.920190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:43.920190 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:43.922758 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 543/1083] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:43.925269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:44.032081 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e7dbd-d245-4bb3-a2f0-b1d5affabffb None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:44.062989 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:44.069491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:44.070255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:44.070542 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:44.070863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:44.071605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:44.071911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:44.073289 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5f586-0edb-428b-8cfb-809777e80818 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:44.085250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 541/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:45.387346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5269a-686a-4db3-bea3-4fdb271a87c0 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.387919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5269a-686a-4db3-bea3-4fdb271a87c0 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.387919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5269a-686a-4db3-bea3-4fdb271a87c0 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.389315 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 544/1085] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:45.394701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.395254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.395254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.412803 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:45.414051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:45.485296 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 542/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:45.508903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5269a-686a-4db3-bea3-4fdb271a87c0 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:45.603271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:45.617747 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5269a-686a-4db3-bea3-4fdb271a87c0 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:45.653849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:45.654576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.654894 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.655176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.665503 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:45.673739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:45.674878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:12:45.675838 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:45.678877 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 545/1087] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:12:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:45.681072 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:45.790594 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99b19-0cfe-40b2-becb-7d59a8e3f9a2 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:45.813714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:45.827079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:45.827772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.828051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.828332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.829133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:45.829444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:45.830862 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a8da6-f948-4b68-b36f-005589394cf9 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:45.839058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 543/1088] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:12:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:45.844857 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:45.905609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d061ff-9c5b-4fe3-8ed8-8e7124521469 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.905822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d061ff-9c5b-4fe3-8ed8-8e7124521469 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.906171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d061ff-9c5b-4fe3-8ed8-8e7124521469 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.907640 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 544/1089] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:45.912739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.913039 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.913287 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.930497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:45.931752 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:45.949856 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0ce-36a3-4fca-8ef1-dde9ae861093 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:45.986803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:45.987589 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:45.987869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:45.988139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:45.998889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.000349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.002103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 545/1090] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:46.008295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:46.018339 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:46.019386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:46.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:46.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:46.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:46.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:46.020381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 546/1091] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:46.025454 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.025746 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.125606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a2a6b-f532-4cec-bc31-4707b786f090 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.126060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b33d0-5ca9-4782-91ec-c52d3c06589e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.139955 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.159543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.160284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.160570 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.160849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.160956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.161639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.161924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.162193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.162963 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:46.163251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.164653 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.171033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:12:46.175816 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 546/1092] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:12:46.178592 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:46.179770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:46.180741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 547/1093] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:46.181676 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.185706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.243766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.281263 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694a07d-c0ed-4b37-9110-90aa09114f36 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.285958 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e365e41-a8ad-497f-aaae-24ccacf89072 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.316324 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.317130 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.317414 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.317688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.319973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.320643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.320926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.321205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.321971 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:46.322279 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.323707 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.325179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.326622 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.331791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 548/1094] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:46.337684 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:12:46.340609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:46.341659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 547/1095] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:46.347979 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.382865 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.437543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e125-198c-4d05-898b-07c1b5ceae33 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.447474 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b39cf-3805-436f-8b0b-2d9d8d483021 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.459162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.477371 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.478263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.478543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.478849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] PATH_INFO: `/v3/users/16dc050725e740d7a15968e2e2cf04c9` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.480055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] RBAC: Authorizing `identity:get_user(user_id=16dc050725e740d7a15968e2e2cf04c9)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.481499 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.481720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.482401 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.482713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.482995 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.483504 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 549/1096] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/users/16dc050725e740d7a15968e2e2cf04c9 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:46.483887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:46.484202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.485635 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.488758 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.507616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 548/1097] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:46.508620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.590383 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d09f-bdb2-4241-8dc4-a0b43d89200a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.604014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.614705 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb1698-d506-446e-810e-8c4b5f70a69d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.625560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.626221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.626509 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.626820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.649724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.650363 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.650665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.650973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.683087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.694198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.695692 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.718069 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.719592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.794172 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 550/1098] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:12:46.800173 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.807866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.818417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 549/1099] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:46.824648 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.890754 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:46.900700 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284af786-e9df-4b92-a8fa-795ec4f07115 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.925479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31f14-715b-475a-afea-f35c21aa51d6 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:46.934458 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.935361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.935648 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.935930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.937146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.938790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.940545 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 551/1100] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:46.946618 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:46.962477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:46.963293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:46.963580 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:46.963856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:46.974413 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:46.975911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:12:46.994627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:46.995747 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:46.996783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:12:46.996783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:12:46.996783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:12:46.996783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:12:46.997025 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 550/1101] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:12:47.003297 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:47.058209 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f4355-cb89-4256-b2ea-3a604716eda2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:47.061152 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:47.092036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:47.092697 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:47.092985 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:47.093263 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:47.094126 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user.id=16dc050725e740d7a15968e2e2cf04c9) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:47.094443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:47.095941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:47.102179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 552/1102] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:46 2022] GET /identity/v3/role_assignments?user.id=16dc050725e740d7a15968e2e2cf04c9&scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:47.116497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c024a2-4a2b-4124-8c27-0e5016398260 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:47.155316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552695-3178-47b5-858c-6da544522b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:47.156002 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552695-3178-47b5-858c-6da544522b1b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:47.156288 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552695-3178-47b5-858c-6da544522b1b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:47.156567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81552695-3178-47b5-858c-6da544522b1b None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:47.157321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552695-3178-47b5-858c-6da544522b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:47.157634 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552695-3178-47b5-858c-6da544522b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:47.159082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81552695-3178-47b5-858c-6da544522b1b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:47.172184 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 551/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:47.178127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:47.206591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:47.289482 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca537-fee3-400c-83e3-62afd5169025 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:47.324910 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:47.325713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:47.325998 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:47.326258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:47.333294 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:47.334778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:12:47.350338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:12:47.351576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:12:47.352543 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 553/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:12:47.357667 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552695-3178-47b5-858c-6da544522b1b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:47.460783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81552695-3178-47b5-858c-6da544522b1b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:47.463186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:47.496868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:47.497537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:47.497822 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:47.498095 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:47.498915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:47.499225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:47.500679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55a335-2ea6-49ce-b4b5-48dd9bfd63a5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:47.513760 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 552/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:47.519985 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:47.605134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:47.624657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05c87-2588-48c9-bd51-0e06b5908d80 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:47.659134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:47.659791 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:47.660081 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:47.660355 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:47.661202 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] RBAC: Adding query filter params (role.id=0f030b68909f4c95b9aff414467ff7f0, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=c7e4a6850d01483b9f9c5ceabd562d91) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:47.661515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:47.662974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca89204-a628-4a58-9a2a-10dc1d54a3f7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:47.668864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 554/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:47 2022] GET /identity/v3/role_assignments?user.id=c7e4a6850d01483b9f9c5ceabd562d91&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=0f030b68909f4c95b9aff414467ff7f0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:49.343674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d446be-4dea-4426-88ed-b21cac3b1c56 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:49.344605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d446be-4dea-4426-88ed-b21cac3b1c56 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:49.344605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d446be-4dea-4426-88ed-b21cac3b1c56 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:49.346852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 553/1107] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:49.352801 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:49.353252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:49.353357 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:49.370908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:49.373037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:49.449767 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 555/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:12:49.475813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d446be-4dea-4426-88ed-b21cac3b1c56 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:49.603673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d446be-4dea-4426-88ed-b21cac3b1c56 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:49.642302 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:49.643209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:49.643492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:49.643779 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:49.645070 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:49.646544 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a71c3-1278-4778-baa8-659f871bcd00 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:49.648253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 554/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:49.654249 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:49.733991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:49.761484 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9d2d-9c48-49fc-8600-e04ecf4fcee2 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:49.805829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:49.806508 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:49.806828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:49.807100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:49.807826 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:49.809281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad63b9-6a3c-4aef-aae5-dde99badc0c1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:49.832736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 556/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:12:49 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:12:52.084243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916c22-3daf-49ef-a1fa-fde60ebc9cb6 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:52.085171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916c22-3daf-49ef-a1fa-fde60ebc9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:52.085171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916c22-3daf-49ef-a1fa-fde60ebc9cb6 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:52.087436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 555/1111] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:52.096480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:52.096915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:52.097068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:52.122593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:52.123844 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:52.198632 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 557/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:52.226510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916c22-3daf-49ef-a1fa-fde60ebc9cb6 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:52.265677 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:52.340278 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916c22-3daf-49ef-a1fa-fde60ebc9cb6 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:52.377604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:52.378461 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:52.378743 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:52.379054 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] PATH_INFO: `/v3/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:52.380688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] RBAC: Authorizing `identity:get_role(role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:52.382073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:52.383603 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 556/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:52 2022] GET /identity/v3/roles/c648a19d06904216a8c19d1bf459539b => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:52.390180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:52.460601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:52.502320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5614c9-3328-41d8-861b-8e3c8aee6f05 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:52.550907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:52.552144 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:52.552443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:52.552714 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] PATH_INFO: `/v3/users/21801c4e1d9b495a8fa23355b456c42f` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:52.569255 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] RBAC: Authorizing `identity:get_user(user_id=21801c4e1d9b495a8fa23355b456c42f)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:52.570797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:52.572532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 558/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:52 2022] GET /identity/v3/users/21801c4e1d9b495a8fa23355b456c42f => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:52.579056 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:52.688416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:52.691541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ce11f-e3e7-4491-a632-2c95e72ca21b None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:52.727444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:52.728087 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:52.728378 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:52.728660 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:52.803620 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:52.805116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:52.905997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:52.910021 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 557/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:52.916421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:53.016650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ba61d-a9f3-4a6b-a754-a205a5621c6a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:53.036911 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:53.053836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:53.054729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:53.055040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:53.055316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:53.056540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:53.057970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278ce7-8bb3-4b47-8138-76214ba28388 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:53.059687 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 559/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:52 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:53.066288 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:53.180699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537d8b-126c-4e17-8f89-0936e5b7ca3f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:53.217904 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:53.218562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:53.218874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:53.219148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:53.219998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user.id=21801c4e1d9b495a8fa23355b456c42f) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:53.220317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:53.221751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a42db-a2fc-4094-9c32-5cdaf6277005 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:53.228610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 558/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:53 2022] GET /identity/v3/role_assignments?user.id=21801c4e1d9b495a8fa23355b456c42f&scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706&role.id=c648a19d06904216a8c19d1bf459539b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:55.425823 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f14-c6ec-4a19-8cd6-eb8de0f4e6e9 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:55.426755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f14-c6ec-4a19-8cd6-eb8de0f4e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:55.426755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c1f14-c6ec-4a19-8cd6-eb8de0f4e6e9 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:55.428892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 560/1118] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:55.435500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:55.436279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:55.436437 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:55.458203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:55.459449 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:55.520432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:55.529790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 559/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:55.552799 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1f14-c6ec-4a19-8cd6-eb8de0f4e6e9 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:55.672362 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c1f14-c6ec-4a19-8cd6-eb8de0f4e6e9 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:55.709147 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:55.709930 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:55.710216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:55.710530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] PATH_INFO: `/v3/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:55.712085 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] RBAC: Authorizing `identity:get_role(role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:55.713463 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:55.714881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 561/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:55 2022] GET /identity/v3/roles/c648a19d06904216a8c19d1bf459539b => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:55.723846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:55.828554 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588ad8-9530-4d21-bb56-d77d929e70ce None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:55.864202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:55.865078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:55.865359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:55.865633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] PATH_INFO: `/v3/users/21801c4e1d9b495a8fa23355b456c42f` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:55.867040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] RBAC: Authorizing `identity:get_user(user_id=21801c4e1d9b495a8fa23355b456c42f)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:55.868484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:55.870125 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 560/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:55 2022] GET /identity/v3/users/21801c4e1d9b495a8fa23355b456c42f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:12:55.876205 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:55.945515 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:55.992813 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0c934-02e6-4b65-80f0-c35247fcb704 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:56.028280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:56.029129 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:56.029410 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:56.029683 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:56.031037 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:56.032502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e644c0-d939-419e-abcf-10da12cc34f8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:56.034200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 562/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:55 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:56.040403 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:56.104945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:56.154917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec376b7-7c3f-4133-bb99-316da586d703 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:56.194485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:56.195619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:56.195908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:56.196186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706/users/21801c4e1d9b495a8fa23355b456c42f/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:56.198823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] RBAC: Authorizing `identity:create_grant(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user_id=21801c4e1d9b495a8fa23355b456c42f, role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:56.200286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad4e33-dfe2-4623-88e5-f17fc451d2bd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:56.217584 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 561/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:12:56 2022] PUT /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706/users/21801c4e1d9b495a8fa23355b456c42f/roles/c648a19d06904216a8c19d1bf459539b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:12:58.392418 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba849f8-64df-4936-9221-d24fd3b40f4c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:58.393295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba849f8-64df-4936-9221-d24fd3b40f4c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:58.393295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba849f8-64df-4936-9221-d24fd3b40f4c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:58.395572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 563/1124] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:12:58.401152 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:58.401614 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:58.401719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:58.420121 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:12:58.421310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:12:58.492696 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 562/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:12:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:12:58.516981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba849f8-64df-4936-9221-d24fd3b40f4c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:58.641650 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba849f8-64df-4936-9221-d24fd3b40f4c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:58.664800 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:58.678735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:58.679622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:58.679908 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:58.680185 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] PATH_INFO: `/v3/roles/c648a19d06904216a8c19d1bf459539b` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:58.681811 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] RBAC: Authorizing `identity:get_role(role_id=c648a19d06904216a8c19d1bf459539b)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:58.683242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:58.684658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 564/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:58 2022] GET /identity/v3/roles/c648a19d06904216a8c19d1bf459539b => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:58.693874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:58.748707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:58.801133 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133727-e81d-4523-8d5c-23e9da797853 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:58.837937 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:58.838845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:58.839132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:58.839407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] PATH_INFO: `/v3/users/21801c4e1d9b495a8fa23355b456c42f` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:58.840756 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] RBAC: Authorizing `identity:get_user(user_id=21801c4e1d9b495a8fa23355b456c42f)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:58.842203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:58.843885 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 563/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:12:58 2022] GET /identity/v3/users/21801c4e1d9b495a8fa23355b456c42f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:58.850349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:58.956681 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c610f6-7832-4c59-b7a3-9228b41ae8f8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:58.998652 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:58.999334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:58.999617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:58.999899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:59.064965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:59.076756 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:59.078229 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:59.189590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 565/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:12:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:12:59.197560 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:59.308278 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212a69-3bee-44d9-9523-9f43e400fbcd None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:59.328864 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:59.345433 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:59.346304 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:59.346586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:59.346901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] PATH_INFO: `/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:59.348096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] RBAC: Authorizing `identity:get_project(project_id=9e8f28b7fcfd4001b3a1cfe3ba5e4706)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:59.349900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fe26c-dafe-47cb-b955-3fac6bc912e7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:59.351707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 564/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:12:59 2022] GET /identity/v3/projects/9e8f28b7fcfd4001b3a1cfe3ba5e4706 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:12:59.358000 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:12:59.453610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:12:59.463630 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c198c-eaeb-4884-a3d2-24fcab91ba6e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:12:59.502706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:12:59.503374 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:12:59.503657 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:12:59.503929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:12:59.504760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] RBAC: Adding query filter params (role.id=c648a19d06904216a8c19d1bf459539b, scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706, user.id=21801c4e1d9b495a8fa23355b456c42f) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:12:59.505091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:12:59.506569 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9249b4-1945-432b-89ac-077bf227c91c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:12:59.513114 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 566/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:12:59 2022] GET /identity/v3/role_assignments?user.id=21801c4e1d9b495a8fa23355b456c42f&scope.project.id=9e8f28b7fcfd4001b3a1cfe3ba5e4706&role.id=c648a19d06904216a8c19d1bf459539b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:13:01.749283 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2620-06e9-4e82-b603-db401ed672e6 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:01.750135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2620-06e9-4e82-b603-db401ed672e6 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:01.750135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb2620-06e9-4e82-b603-db401ed672e6 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:01.752250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 565/1131] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:01.758603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:01.759388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:01.759549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:01.782142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:01.783346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:01.854252 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 567/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:01.877518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb2620-06e9-4e82-b603-db401ed672e6 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:01.990593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb2620-06e9-4e82-b603-db401ed672e6 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:02.026228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:02.026998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:02.027277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:02.027548 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:02.028860 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:02.030321 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940131cd-a9ec-41a2-83b1-a42c8df447fa None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:02.031951 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 566/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:02.041295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:02.132491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:02.147474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7274f-d8f5-4194-ac18-168939b4b3ff None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:02.181627 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:02.182283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:02.182560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:02.182865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:02.183573 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:02.185011 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778829f-8b48-430f-ad6a-1afa5f9da306 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:02.213241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 568/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:13:02 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:13:04.439355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544d7b-1052-4576-9e8a-abe7b9897537 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:04.439997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544d7b-1052-4576-9e8a-abe7b9897537 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:04.439997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1544d7b-1052-4576-9e8a-abe7b9897537 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:04.441264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 567/1135] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:04.447480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:04.447480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:04.447962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:04.467169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:04.468759 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:04.537013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 569/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:04.562124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544d7b-1052-4576-9e8a-abe7b9897537 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:04.621456 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:04.667776 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1544d7b-1052-4576-9e8a-abe7b9897537 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:04.701636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:04.702367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:04.702652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:04.702961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] PATH_INFO: `/v3/domains/default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:04.704175 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:04.705629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a3b5d-77cc-4b87-b8a5-5bc40f02eddb None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:04.707293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 568/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:04.713577 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:04.785682 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:04.821770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40c548-f4bb-4f27-b052-9e8acf6a6da7 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:04.859766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:04.860431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:04.860717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:04.860990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:04.861708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:04.863186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad472be-c455-4379-b6a3-36ce43830cca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:04.885092 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 570/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:13:04 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:13:07.109772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe8ad-83f6-41dc-bdb2-e2a6a429e5ef None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.110708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe8ad-83f6-41dc-bdb2-e2a6a429e5ef None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.110708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe8ad-83f6-41dc-bdb2-e2a6a429e5ef None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:07.112862 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 569/1139] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:07.120879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.121322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.121467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:07.148500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:07.149727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:07.225290 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 571/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:07.256179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fe8ad-83f6-41dc-bdb2-e2a6a429e5ef None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:07.392497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fe8ad-83f6-41dc-bdb2-e2a6a429e5ef None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:07.417292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:07.431221 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:07.432029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.432320 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.432597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:07.444331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:07.452201 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:07.453345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:07.454486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:07.458407 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 570/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:07.459610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:07.516774 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:07.564707 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cc56a-3c9a-4bb5-be55-57168e3a5487 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:07.601248 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:07.601919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.602201 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.602483 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:07.603284 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:07.603597 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:07.604987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:07.613214 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 572/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:13:07.619410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:07.726486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb677-0fd2-4964-a073-f20f975d902e None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:07.764603 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:07.765471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.765724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.766020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] PATH_INFO: `/v3/users/c39766ad5a824d47b3bb29b2cfe1155c` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:07.779929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] RBAC: Authorizing `identity:get_user(user_id=c39766ad5a824d47b3bb29b2cfe1155c)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:07.781383 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:07.783433 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 571/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:07 2022] GET /identity/v3/users/c39766ad5a824d47b3bb29b2cfe1155c => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:07.792233 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:07.900869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccea59-c472-41e0-9b16-b49ca35c787f None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:07.916932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:07.936915 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:07.937561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:07.937845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:07.938121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:08.009262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:08.010655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:08.116167 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 573/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:13:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:13:08.123014 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:08.174837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:08.234174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd72ca-52d9-4601-b3b3-f74103729304 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:08.269606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:08.270405 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:08.270712 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:08.271008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] PATH_INFO: `/v3/projects/f16d88a6b5ce4f9fad59974788881cc6` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:08.272325 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] RBAC: Authorizing `identity:get_project(project_id=f16d88a6b5ce4f9fad59974788881cc6)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:08.273782 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454880-f852-443a-a9aa-e4a35bb5f490 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:08.275507 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 572/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:08 2022] GET /identity/v3/projects/f16d88a6b5ce4f9fad59974788881cc6 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:08.281860 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:08.299785 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:08.392519 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b674688-dab2-4ae7-b814-ccb7b4598569 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:08.434704 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:08.435883 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:08.436288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:08.436686 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:08.438033 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=f16d88a6b5ce4f9fad59974788881cc6, user.id=c39766ad5a824d47b3bb29b2cfe1155c) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:08.438500 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:08.440804 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6f4a-721b-4140-bea6-dc7d20bb4308 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:08.448277 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 574/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:13:08 2022] GET /identity/v3/role_assignments?user.id=c39766ad5a824d47b3bb29b2cfe1155c&scope.project.id=f16d88a6b5ce4f9fad59974788881cc6&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:10.633527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc341-6e29-4175-806c-ed11fd763545 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:10.634110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc341-6e29-4175-806c-ed11fd763545 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:10.634110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc341-6e29-4175-806c-ed11fd763545 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:10.636242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 573/1147] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:10.644180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:10.644661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:10.644766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:10.663606 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:10.664797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:10.742564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 575/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:13:10.765746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc341-6e29-4175-806c-ed11fd763545 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:10.877541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc341-6e29-4175-806c-ed11fd763545 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:10.889227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:10.919117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:10.919909 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:10.920199 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:10.920472 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:10.931799 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:10.939506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:10.940646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:10.941617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 574/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:10.948616 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:10.960736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:11.067170 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dac4-f89d-40f0-b05f-e041f7d9909a None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:11.103067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:11.103732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:11.104015 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:11.104296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:11.105058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:11.105363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:11.106740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:11.115429 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 576/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:11.121901 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:11.236196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582e3e2-66e3-49b0-b018-be9f21a086aa None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:11.271096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:11.271961 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:11.272241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:11.272546 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] PATH_INFO: `/v3/users/c39766ad5a824d47b3bb29b2cfe1155c` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:11.273786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] RBAC: Authorizing `identity:get_user(user_id=c39766ad5a824d47b3bb29b2cfe1155c)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:11.275284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:11.276920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 575/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:11 2022] GET /identity/v3/users/c39766ad5a824d47b3bb29b2cfe1155c => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:11.283058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:11.369004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:11.400435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b4758-cc4b-41cf-a71e-756b9ac00f06 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:11.436023 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:11.436912 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:11.437168 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:11.437443 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] PATH_INFO: `/v3/projects/f16d88a6b5ce4f9fad59974788881cc6` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:11.438675 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] RBAC: Authorizing `identity:get_project(project_id=f16d88a6b5ce4f9fad59974788881cc6)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:11.440154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6167ff-42a7-4889-84dc-4ec88a3c126a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:11.441889 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 577/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:11 2022] GET /identity/v3/projects/f16d88a6b5ce4f9fad59974788881cc6 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:11.448929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:11.497197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:11.558220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc58ec-5de6-4f43-9356-f5232c5dd415 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:11.594599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:11.595525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:11.595804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:11.596073 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] PATH_INFO: `/v3/projects/f16d88a6b5ce4f9fad59974788881cc6/users/c39766ad5a824d47b3bb29b2cfe1155c/roles/3d4222f61d774512b154900643156352` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:11.598292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=f16d88a6b5ce4f9fad59974788881cc6, user_id=c39766ad5a824d47b3bb29b2cfe1155c, role_id=3d4222f61d774512b154900643156352)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:11.600081 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090f39-f933-4fb5-ab15-9b3a6c4dfb13 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:11.618451 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 576/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:13:11 2022] PUT /identity/v3/projects/f16d88a6b5ce4f9fad59974788881cc6/users/c39766ad5a824d47b3bb29b2cfe1155c/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:13:13.786318 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb83d-4e07-404c-acd0-a5a0091cebf0 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:13.787244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb83d-4e07-404c-acd0-a5a0091cebf0 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:13.787244 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb83d-4e07-404c-acd0-a5a0091cebf0 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:13.789391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 578/1154] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:13.797587 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:13.798058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:13.798169 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:13.817556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:13.818734 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:13.888185 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 577/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:13:13.911949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb83d-4e07-404c-acd0-a5a0091cebf0 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:14.030273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb83d-4e07-404c-acd0-a5a0091cebf0 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:14.065469 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:14.066193 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:14.066471 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:14.066774 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:14.074744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:14.078404 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:14.086905 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:14.088041 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:13:14.089449 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 579/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:14.096998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:14.127926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:14.208686 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4397-1f15-40b3-92a3-3b023a68e14f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:14.246628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:14.247330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:14.247615 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:14.247895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:14.248661 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:14.248969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:14.250360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:14.258713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 578/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:14.264878 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:14.373437 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7752b2-a7c3-4bbf-b698-8b98d3b716fd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:14.410862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:14.412188 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:14.412608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:14.413135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] PATH_INFO: `/v3/users/c39766ad5a824d47b3bb29b2cfe1155c` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:14.414537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] RBAC: Authorizing `identity:get_user(user_id=c39766ad5a824d47b3bb29b2cfe1155c)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:14.416039 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:14.417690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 580/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:14 2022] GET /identity/v3/users/c39766ad5a824d47b3bb29b2cfe1155c => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:14.423783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:14.522674 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:14.533830 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b5a96-364e-4a0b-ae41-b38758151317 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:14.571410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:14.572058 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:14.572349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:14.572629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:14.656804 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:14.658282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:14.757160 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:14.768757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 579/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:13:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:13:14.775004 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:14.844311 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:14.878833 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e6ba7-3f6f-4761-a9e1-2aaacc377144 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:14.915628 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:14.916426 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:14.916707 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:14.916990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] PATH_INFO: `/v3/projects/f16d88a6b5ce4f9fad59974788881cc6` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:14.918241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] RBAC: Authorizing `identity:get_project(project_id=f16d88a6b5ce4f9fad59974788881cc6)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:14.919729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dcb4-b60c-42ee-b760-bab03a5d57ec None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:14.921446 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 581/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:14 2022] GET /identity/v3/projects/f16d88a6b5ce4f9fad59974788881cc6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:14.927815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:15.039874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c21a8-ebb5-4d9a-a8cb-885c9c0ee438 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:15.075501 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:15.076147 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:15.076423 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:15.076697 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:15.077549 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=f16d88a6b5ce4f9fad59974788881cc6, user.id=c39766ad5a824d47b3bb29b2cfe1155c) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:15.077863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:15.079352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56b6a6-3410-4a7f-a818-7d02e9dc19bf None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:15.085448 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 580/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:13:14 2022] GET /identity/v3/role_assignments?user.id=c39766ad5a824d47b3bb29b2cfe1155c&scope.project.id=f16d88a6b5ce4f9fad59974788881cc6&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:17.330441 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169519f2-7751-4a9e-a01b-5d900fc78447 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:17.331405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169519f2-7751-4a9e-a01b-5d900fc78447 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:17.331529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169519f2-7751-4a9e-a01b-5d900fc78447 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:17.333734 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 582/1162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:17.340299 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:17.340753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:17.340868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:17.363790 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:17.364999 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:17.423461 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:17.442465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 581/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:17.465251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169519f2-7751-4a9e-a01b-5d900fc78447 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:17.582007 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169519f2-7751-4a9e-a01b-5d900fc78447 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:17.618251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:17.619043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:17.619335 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:17.619603 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:17.623322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:17.697253 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:17.698738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:17.799540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 583/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:13:17.806132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:17.916671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979904-1864-43c7-a78b-f74750dd03ec None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:17.951971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:17.952755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:17.953036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:17.953308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:17.960237 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:17.961691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-19bc7ba6-11d9-4e40-b925-e26a737e822e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:17.976400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:17.977688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:17.978749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 582/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:13:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:17.985138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:18.028450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:18.110777 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ece65-29af-4a4e-81f3-62f7bcdd284e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:18.145994 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:18.146654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:18.146972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:18.147243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:18.147999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:18.148301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:18.149678 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644d600-d966-4167-ab27-3fb614a7eed4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:18.156945 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 584/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:13:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:13:20.369749 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a59c-71eb-44db-b74f-47b8bcf739d2 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:20.370352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a59c-71eb-44db-b74f-47b8bcf739d2 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:20.370352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96a59c-71eb-44db-b74f-47b8bcf739d2 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:20.371719 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 583/1167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:20.378183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353faeb-f41c-4c9b-a481-bbdb006c9bd1 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:20.378961 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353faeb-f41c-4c9b-a481-bbdb006c9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:20.379143 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353faeb-f41c-4c9b-a481-bbdb006c9bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:20.399594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-2353faeb-f41c-4c9b-a481-bbdb006c9bd1 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:20.400820 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-2353faeb-f41c-4c9b-a481-bbdb006c9bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:20.474031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 585/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:20.499016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96a59c-71eb-44db-b74f-47b8bcf739d2 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:20.548806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:20.610341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96a59c-71eb-44db-b74f-47b8bcf739d2 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:20.650281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:20.650987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:20.651278 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:20.651557 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:20.652322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:20.653715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80416b0-e99d-4bd3-abf7-882aae4657d6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:20.677623 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 584/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Thu May 19 20:13:20 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:13:22.918312 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da955-841e-4085-88c1-e661c8e598f6 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:22.919293 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da955-841e-4085-88c1-e661c8e598f6 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:22.919293 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da955-841e-4085-88c1-e661c8e598f6 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:22.921554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 586/1170] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:22.930345 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:22.930866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:22.931027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:22.949736 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:22.950955 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:23.021338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 585/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:13:23.045256 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da955-841e-4085-88c1-e661c8e598f6 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:23.079732 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:23.155652 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da955-841e-4085-88c1-e661c8e598f6 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:23.190996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:23.191779 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:23.192058 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:23.192333 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] PATH_INFO: `/v3/domains/a576a65b67554bf3b65152a92d6c0aea` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:23.203666 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a576a65b67554bf3b65152a92d6c0aea)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:23.205135 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838468-16fd-49e6-9adc-4f152f48a691 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:23.206830 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 587/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 20:13:23 2022] GET /identity/v3/domains/a576a65b67554bf3b65152a92d6c0aea => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:23.213130 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:23.249241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:23.317875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68362-6a16-45bd-b85d-10cb6741997e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:23.353730 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:23.354395 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:23.354678 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:23.354982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:23.355707 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:23.357162 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662fd2c-b21b-468b-b00e-ddb540aef4b3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:23.385255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 586/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:13:23 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:13:25.619542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ff1d-f8b9-47d3-9343-e82db5aa67b4 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:25.620136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ff1d-f8b9-47d3-9343-e82db5aa67b4 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:25.620136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64ff1d-f8b9-47d3-9343-e82db5aa67b4 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:25.621487 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 588/1174] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:25.628015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:25.628510 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:25.629171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:25.649378 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:25.650605 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:25.725209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 587/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:25.750150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64ff1d-f8b9-47d3-9343-e82db5aa67b4 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:25.847215 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:25.866117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64ff1d-f8b9-47d3-9343-e82db5aa67b4 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:25.903661 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:25.904626 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:25.905023 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:25.905394 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] PATH_INFO: `/v3/domains/a576a65b67554bf3b65152a92d6c0aea` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:25.906880 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=a576a65b67554bf3b65152a92d6c0aea)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:25.908459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab0716-a749-4ebf-977c-adfd8ed0fdec None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:25.910088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 589/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 20:13:25 2022] GET /identity/v3/domains/a576a65b67554bf3b65152a92d6c0aea => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:25.916122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:25.934216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:26.037997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7b7b-062e-4b5d-9d03-48b0a33d9184 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:26.073336 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:26.074008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:26.074293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:26.074573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:26.075337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:26.076783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9f959-9719-46d6-832a-929a3719a4e7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:26.103665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 588/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:13:25 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:13:28.398125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501986-de9d-47db-b6ea-0ef6bc76f776 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:28.399238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501986-de9d-47db-b6ea-0ef6bc76f776 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:28.399238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae501986-de9d-47db-b6ea-0ef6bc76f776 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:28.401273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 590/1178] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:28.410292 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:28.410739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:28.410920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:28.430176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:28.431409 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:28.502031 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 589/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:28.526514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae501986-de9d-47db-b6ea-0ef6bc76f776 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:28.654913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae501986-de9d-47db-b6ea-0ef6bc76f776 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:28.697658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:28.698466 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:28.698772 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:28.699047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:28.711591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:28.719262 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:28.720395 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:13:28.721427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 591/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:28.727353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:28.729526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:28.831643 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4af42-889b-4a74-ada0-7c996d83ea7d None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:28.866215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:28.866947 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:28.867231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:28.867511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:28.868275 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:28.868586 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:28.869995 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:28.879191 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 590/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:28.885402 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:28.908148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:28.991923 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbbd98-e7bf-4877-89a2-f02897ea8d50 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:29.027139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:29.027981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:29.028259 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:29.028529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] PATH_INFO: `/v3/users/b8774eaf240b4e61b029f459b25da802` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:29.042281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] RBAC: Authorizing `identity:get_user(user_id=b8774eaf240b4e61b029f459b25da802)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:29.043757 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:29.045413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 592/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:28 2022] GET /identity/v3/users/b8774eaf240b4e61b029f459b25da802 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:29.051551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:29.127243 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:29.171891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765620e-d115-41b7-923c-5125359ea7e3 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:29.211168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:29.211820 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:29.212100 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:29.212374 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:29.285398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:29.286887 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:29.354821 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:29.393399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 591/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:13:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:13:29.399719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:29.484712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:29.510169 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d358c0-c888-4506-93ec-014733e5526c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:29.551467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:29.552340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:29.552621 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:29.552895 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] PATH_INFO: `/v3/projects/d8a41a550ce0499dbdf6381eb320f504` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:29.554410 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] RBAC: Authorizing `identity:get_project(project_id=d8a41a550ce0499dbdf6381eb320f504)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:29.555920 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88627a4-eefb-4dda-a238-88334fd55126 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:29.557668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 593/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:29 2022] GET /identity/v3/projects/d8a41a550ce0499dbdf6381eb320f504 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:29.564672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:29.674969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a29591-bf7b-4b62-ad32-36df75c6c044 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:29.714912 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:29.715568 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:29.715845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:29.716119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:29.716953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=d8a41a550ce0499dbdf6381eb320f504, user.id=b8774eaf240b4e61b029f459b25da802) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:29.717261 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:29.718717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431d3b1-ee2f-4a25-87dd-dabf73f4883d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:29.725045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 592/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:13:29 2022] GET /identity/v3/role_assignments?user.id=b8774eaf240b4e61b029f459b25da802&scope.project.id=d8a41a550ce0499dbdf6381eb320f504&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:31.874523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d756-0eb5-4e0b-886a-5726fb0ca88b None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:31.875137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d756-0eb5-4e0b-886a-5726fb0ca88b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:31.875137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d756-0eb5-4e0b-886a-5726fb0ca88b None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:31.876400 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 594/1186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:31.882065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:31.882513 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:31.882629 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:31.905688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:31.906925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:31.933787 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:31.991811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 593/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:32.014858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316d756-0eb5-4e0b-886a-5726fb0ca88b None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:32.126978 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316d756-0eb5-4e0b-886a-5726fb0ca88b None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:32.163831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:32.164613 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:32.164896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:32.165171 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:32.176204 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:32.183819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:32.185034 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:13:32.186555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 595/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:32.195330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:32.300101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f5eeb-ac0f-433b-91ab-39cee9393f0e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:32.335757 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:32.336432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:32.336717 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:32.336978 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:32.337739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:32.338050 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:32.339462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:32.348230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 594/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:32.358334 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:32.364711 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:32.475819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47250d49-f593-416c-85a2-7aafdd7bef01 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:32.510467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:32.511363 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:32.511642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:32.511913 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] PATH_INFO: `/v3/users/b8774eaf240b4e61b029f459b25da802` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:32.513157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=b8774eaf240b4e61b029f459b25da802)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:32.514594 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:32.516257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 596/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:32 2022] GET /identity/v3/users/b8774eaf240b4e61b029f459b25da802 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:32.522322 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:32.547750 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:32.637823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637edcd0-2668-48ff-bf8f-e1f33a7f0779 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:32.678450 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:32.679375 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:32.679663 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:32.679943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] PATH_INFO: `/v3/projects/d8a41a550ce0499dbdf6381eb320f504` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:32.681301 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] RBAC: Authorizing `identity:get_project(project_id=d8a41a550ce0499dbdf6381eb320f504)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:32.682793 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4a891-1241-4a51-9b10-f4dae350998f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:32.684680 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 595/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:32 2022] GET /identity/v3/projects/d8a41a550ce0499dbdf6381eb320f504 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:32.691098 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:32.763418 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:32.794274 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792cd1-6a58-44dc-9729-d8c717879ac9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:32.831325 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:32.832208 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:32.832485 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:32.832753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] PATH_INFO: `/v3/projects/d8a41a550ce0499dbdf6381eb320f504/users/b8774eaf240b4e61b029f459b25da802/roles/3d4222f61d774512b154900643156352` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:32.835051 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8a41a550ce0499dbdf6381eb320f504, user_id=b8774eaf240b4e61b029f459b25da802, role_id=3d4222f61d774512b154900643156352)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:32.836492 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7c28d-b915-48d1-9192-dc2669f3c826 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:32.852551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 597/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:13:32 2022] PUT /identity/v3/projects/d8a41a550ce0499dbdf6381eb320f504/users/b8774eaf240b4e61b029f459b25da802/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:13:35.014932 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa770d9-56b3-4865-bd28-122fe55c883a None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.015538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa770d9-56b3-4865-bd28-122fe55c883a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.015538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa770d9-56b3-4865-bd28-122fe55c883a None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.016873 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 596/1193] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:13:35.023669 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.024435 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.024576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.053985 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:13:35.055242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:13:35.128470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 598/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:13:35.153230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa770d9-56b3-4865-bd28-122fe55c883a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:35.259020 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:35.274589 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa770d9-56b3-4865-bd28-122fe55c883a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:35.310925 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:35.311724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.312006 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.312281 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.323879 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:13:35.331662 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:13:35.332811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:13:35.333895 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 597/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:13:35.339376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:35.402868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:35.443841 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e485d5-74cb-4e38-bfbe-9249e558cd7e None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:35.483035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:35.484108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.484511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.484837 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.485797 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:35.486134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:35.487755 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:35.497881 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 599/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:13:35.503945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:35.613604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391fd35-f9b4-406a-a579-a6b81e56a186 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:35.648487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:35.649353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.649636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.649908 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] PATH_INFO: `/v3/users/b8774eaf240b4e61b029f459b25da802` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.651156 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] RBAC: Authorizing `identity:get_user(user_id=b8774eaf240b4e61b029f459b25da802)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:35.652617 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:35.654269 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 598/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:13:35 2022] GET /identity/v3/users/b8774eaf240b4e61b029f459b25da802 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:35.660451 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:35.778496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd6ca-5a30-4276-bfb6-5bd4c816d3c8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:35.801702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:35.815373 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:35.816028 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:35.816322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:35.816598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:35.887368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:35.888866 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:35.993976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 600/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:13:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:13:36.001052 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:36.023244 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:36.109714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8425-0780-4955-a14f-146294b40869 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:36.149679 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:36.150944 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:36.151355 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:36.151778 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] PATH_INFO: `/v3/projects/d8a41a550ce0499dbdf6381eb320f504` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:36.153899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] RBAC: Authorizing `identity:get_project(project_id=d8a41a550ce0499dbdf6381eb320f504)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:36.156250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a4774-f28d-4e45-96e8-222fa5243555 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:36.159151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 599/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:13:35 2022] GET /identity/v3/projects/d8a41a550ce0499dbdf6381eb320f504 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:36.168012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:13:36.198112 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:36.281819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c12943-d43e-40ce-8c47-07b94fbe4be2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:13:36.319598 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:13:36.320246 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:13:36.320530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:13:36.320810 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:13:36.321662 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=d8a41a550ce0499dbdf6381eb320f504, user.id=b8774eaf240b4e61b029f459b25da802) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:13:36.321973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:13:36.323445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cab01-e203-4590-9ee8-91bc4c2ea37d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:13:36.329692 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 601/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:13:36 2022] GET /identity/v3/role_assignments?user.id=b8774eaf240b4e61b029f459b25da802&scope.project.id=d8a41a550ce0499dbdf6381eb320f504&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:13:46.141003 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=58 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:13:46.327038 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=56 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:34.658671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1313a2-0d58-4032-8ffa-fe594b517df4 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:34.659338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1313a2-0d58-4032-8ffa-fe594b517df4 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:34.659338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1313a2-0d58-4032-8ffa-fe594b517df4 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:34.660833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 600/1201] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:34.666111 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:34.666558 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:34.666647 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:34.684329 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:34.685510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:34.757163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 602/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:34.782061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1313a2-0d58-4032-8ffa-fe594b517df4 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:34.891035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1313a2-0d58-4032-8ffa-fe594b517df4 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:34.926883 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:34.927691 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:34.927983 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:34.928310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:34.938825 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:34.940394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:34.958016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:34.959524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:34.960624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:34.960624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:34.960624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:34.960624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:34.960624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 601/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:34.965321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:35.076828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b489b3-0447-4917-91f3-e2ad3bdf0dc3 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:35.107411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:35.113806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:35.114487 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:35.114812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:35.115094 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:35.115863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:35.116172 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:35.117612 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b853bb5-098d-4179-8193-11edb696ec01 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:35.134780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 603/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:35.138260 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:35.204092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:35.263614 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba623-120b-43d9-9ec8-ab08264cf31d None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:35.311451 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:35.312197 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:35.312485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:35.312759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:35.313491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:35.315360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0082c71-bd94-419e-a691-055b26f84123 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:35.340360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 602/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:14:35 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:14:37.743125 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3552a-28d5-4e25-9c07-7647f971992f None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:37.743694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3552a-28d5-4e25-9c07-7647f971992f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:37.743694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3552a-28d5-4e25-9c07-7647f971992f None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:37.745216 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 604/1206] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:37.751610 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:37.752099 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:37.752200 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:37.771969 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:37.773671 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:37.855715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 603/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:37.881608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3552a-28d5-4e25-9c07-7647f971992f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:38.007517 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3552a-28d5-4e25-9c07-7647f971992f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:38.045236 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:38.046090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:38.046378 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:38.049137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:38.061055 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:14:38.070032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:38.071283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:38.072345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 605/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:38.078063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:38.123621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:38.195729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f7b8c-79b7-42bb-820b-f050281dc5f7 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:38.237524 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:38.238203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:38.238486 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:38.238794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:38.239710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:38.239994 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:38.241859 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:38.254733 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 604/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:14:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:38.257162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:38.315988 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:38.383560 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadbc2-4b50-462e-bcc0-29b35be21cef None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:38.432474 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:38.433450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:38.433722 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:38.433984 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:38.447653 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:38.449217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:38.469713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:38.470981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:38.472066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:38.472066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:38.472066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:38.472066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:38.472066 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 606/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:38.479998 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:38.605899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:38.608746 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d30640-a1df-44fa-9fad-e3f99b7352a0 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:38.654116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:38.654842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:38.655126 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:38.655496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:38.656311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:38.656593 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:38.658384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:38.671754 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 605/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:38.677461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:38.801639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05629724-f2bd-4954-998f-89248622d0c9 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:38.803285 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:38.842146 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:38.843104 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:38.843388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:38.843667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:38.853459 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:38.854946 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:14:38.872505 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:38.873663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:38.875195 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:38.878571 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 607/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:38.880104 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:39.000953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218476-5df4-4574-8569-9b79d6d7a51f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:39.039555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:39.040247 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:39.040527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:39.040803 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:39.041847 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:39.042172 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:39.043755 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:39.062110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 606/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:14:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:39.067751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:39.195162 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a449d1-e951-4b70-ab39-737bf5c16e3e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:39.239341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:39.240796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:39.241218 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:39.241639 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:39.282502 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:39.330047 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:39.331738 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:39.455240 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 608/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:14:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:14:39.456279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:39.478075 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:39.573102 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bb1fa-02d3-46f2-add7-a29e4dcca23a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:39.614896 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:39.615837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:39.616129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:39.616434 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:39.627726 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:39.629229 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:39.649211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:39.650311 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:39.651338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:39.651338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:39.651338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:39.651338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:39.651338 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 607/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:14:39.656619 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:39.728153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:39.773579 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0effcf6-9a20-4375-a114-2f5eec5a37ca None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:39.818160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:39.818993 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:39.819261 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:39.819480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:39.820261 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:39.820541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:39.822157 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:39.836464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 609/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:39.843633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:39.921462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:39.963774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba38c-6157-4105-9ded-6bed4c816bf4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:40.003236 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:40.004076 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:40.004361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:40.004628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:40.011673 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:40.013140 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:14:40.028934 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:40.030174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:40.031212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 608/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:14:40.036117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:40.146127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877177f9-1875-4672-a364-7fa4d3c27d7d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:40.170698 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:40.188176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:40.188932 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:40.189219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:40.189536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:40.190381 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:40.190702 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:40.192260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de119d21-f89e-4e0b-a9f8-2ed35980f018 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:40.210356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 610/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:40.212135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:40.328298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419cbec-1a29-4b21-b497-08b4ebaaf8ce None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:40.362176 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:40.371600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:40.372398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:40.373487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:40.373487 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:40.373972 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=83d3b227fbcc4d409c4e168395eb364a) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:40.374210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:40.375843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa0ba1-4fa0-48d0-9ce6-edd08d87c985 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:40.382980 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 609/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:14:40 2022] GET /identity/v3/role_assignments?user.id=83d3b227fbcc4d409c4e168395eb364a&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:42.601736 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02f4d-8da3-4cff-92b9-698d31eae531 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:42.602427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02f4d-8da3-4cff-92b9-698d31eae531 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:42.602427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be02f4d-8da3-4cff-92b9-698d31eae531 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:42.603976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 611/1220] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:42.609604 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:42.610122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:42.610233 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:42.628555 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:42.629919 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:42.711455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 610/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:42.736663 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02f4d-8da3-4cff-92b9-698d31eae531 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:42.851199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be02f4d-8da3-4cff-92b9-698d31eae531 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:42.894863 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:42.896215 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:42.896903 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:42.897341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:42.912045 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:14:42.920012 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:42.921351 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:42.922419 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 612/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:42.927367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.031146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235c03-7f88-4cae-bebc-f6de9201fd85 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:43.056151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:43.069212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:43.070188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:43.070520 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:43.070845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:43.071806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] RBAC: Adding query filter params (name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:43.072264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:43.073889 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:43.083769 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 611/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:43.090238 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.150713 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:43.230093 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235fa88-fcf4-4241-a2e1-b2376d5375a0 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:43.268522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:43.269330 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:43.269682 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:43.269966 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:43.281688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:43.283134 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:43.300862 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:43.302369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:43.303892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:43.303892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:43.303892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:43.303892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:43.303892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 613/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:43.308370 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.430502 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a231c-d2a5-4111-b25a-f6d426319d8f None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:43.470446 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:43.471224 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:43.471532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:43.471805 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:43.472573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:43.472858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:43.474561 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:43.489151 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 612/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:43.495851 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.594258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:43.602415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a7689-4ca7-499f-a209-2a0b8baf3d44 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:43.644672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:43.646044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:43.646044 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:43.646328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:43.655251 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:43.656987 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:14:43.673322 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:43.674512 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:43.675879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 614/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:14:43.680864 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.737179 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:43.796915 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67794ea-f7ff-4ea1-933c-e6f0a9bfeae4 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:43.841953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:43.842724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:43.843149 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:43.843430 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:43.844491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:43.844809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:43.846763 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:43.868343 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 613/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:14:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:43.874260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:43.990320 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed40648-f07a-426a-a571-a0a5227e1025 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:44.024049 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:44.024890 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:44.025280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:44.025489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:44.037060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:44.038796 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:44.059338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:44.060642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:44.066822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:44.066822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:44.066822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:44.066822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:44.066822 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 615/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:44.067217 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:44.183681 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00ffe-a970-4265-bb98-cab1ec7ff389 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:44.186470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:44.223661 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:44.224398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:44.224731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:44.225029 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:44.225813 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:44.226124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:44.227609 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:44.240157 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 614/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:44.246329 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:44.255336 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:44.350918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e580b-5a8e-47ba-81af-88b8540a7b0a None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:44.388387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:44.389180 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:44.389464 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:44.389739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:44.397382 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:44.398962 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:14:44.417105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:44.418433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:44.419679 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 616/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:44.425624 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:44.546036 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bfb8b-063a-4dc3-9d6d-803c7d4c019a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:44.582077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:44.582802 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:44.583093 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:44.583384 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:44.584314 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:44.584636 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:44.586188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f680e-b2b5-4f99-a173-041f5fc99470 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:44.605444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 615/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:44.606718 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:44.674706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:44.711529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627974d-47f4-460e-aa0a-5788b4896fe6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:44.746710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:44.747706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] REQUEST_METHOD: `PUT` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:44.748059 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:44.748361 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/83d3b227fbcc4d409c4e168395eb364a/roles/47b1d1c854974de186b26368cbda5785` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:44.763358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=83d3b227fbcc4d409c4e168395eb364a, role_id=47b1d1c854974de186b26368cbda5785)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:44.764827 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e7ab6-941e-4c9b-944d-81d6c3db52d4 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:44.778949 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 617/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:14:44 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/83d3b227fbcc4d409c4e168395eb364a/roles/47b1d1c854974de186b26368cbda5785 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:14:47.204710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b2f2-fbfc-460c-914f-a66096d2ea33 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:47.205366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b2f2-fbfc-460c-914f-a66096d2ea33 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:47.205366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b2f2-fbfc-460c-914f-a66096d2ea33 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:47.206823 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 616/1233] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:47.212704 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:47.213185 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:47.213299 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:47.231766 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:47.233321 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:47.305525 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 618/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:47.330470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b2f2-fbfc-460c-914f-a66096d2ea33 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:47.359124 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:47.440166 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b2f2-fbfc-460c-914f-a66096d2ea33 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:47.481143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:47.481898 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:47.482231 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:47.482564 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] PATH_INFO: `/v3/roles/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:47.495685 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:14:47.505455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:47.507032 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:47.508360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 617/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:14:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:47.513341 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:47.568222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:47.629447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8c6a5-b0fe-48bb-a848-1d5fe416d9fd None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:47.669467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:47.670153 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:47.670440 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:47.670739 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:47.671514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:47.671819 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:47.673222 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:47.682989 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 619/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:14:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:47.689000 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:47.777351 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:47.794426 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae49cf-2262-4e2d-81bd-7e43bc13c17a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:47.829182 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:47.830061 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:47.830307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:47.830527 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:47.841693 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:47.843181 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:47.860556 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:47.866851 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:47.868144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:47.868144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:47.868144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:47.868144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:47.868144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 618/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:47.868520 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:47.977043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221962-4589-4451-aaf6-60666eb355c8 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:47.987590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:48.014976 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:48.015651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:48.015934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:48.016210 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:48.016950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:48.017260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:48.018646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:48.031042 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 620/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:48.036848 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:48.144911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b200bc7-a40f-4af4-894e-b58332bf86b6 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:48.182576 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:48.183422 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:48.183708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:48.183985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:48.186739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:48.192199 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:48.193891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:14:48.208796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:48.210573 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:48.211946 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:48.215341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 619/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:48.216200 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:48.320637 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54641d9-8bcd-454c-8ee5-6b5e4fda8fef None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:48.356572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:48.357306 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:48.357617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:48.357918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:48.359077 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:48.359428 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:48.361257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:48.382199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 621/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:14:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:48.388225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:48.502957 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9449-18fc-4f4f-846f-ad1e16edd5a1 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:48.539809 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:48.540471 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:48.540771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:48.541053 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:48.617168 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:48.624803 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:48.626277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:48.741370 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 620/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:14:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:14:48.747649 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:48.779919 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:48.858388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618068b-1377-457f-8cc4-aaf599803efa None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:48.895729 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:48.896730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:48.897035 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:48.897295 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:48.909349 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:48.910960 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:48.931550 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:48.932849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:48.934230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:48.934230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:48.934230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:48.934230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:48.934230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 622/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:48.939040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:49.048293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:49.055834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76418-ad78-45e0-815c-d89de29bba79 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:49.093522 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:49.094225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:49.094503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:49.094811 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:49.095525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:49.095846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:49.097447 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:49.111027 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 621/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:49.117127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:49.211549 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:49.234975 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91335300-81b9-4b8c-9c26-ba4d31ca8d81 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:49.272060 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:49.272940 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:49.273175 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:49.273475 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:49.281530 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:49.283281 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:14:49.297690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:49.298943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:49.299977 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:49.304301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 623/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:49.305215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:49.417537 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da4d7f-3622-44c8-b1e2-05879cc99d72 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:49.454996 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:49.455958 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:49.456286 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:49.456715 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:49.457890 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:49.458382 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:49.459995 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa78fe-8a70-41cc-944e-82e0470f90c7 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:49.477718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 622/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:14:49.484016 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:49.592574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535040-fd68-4b37-8bd8-e01a89a8db75 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:49.631665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:49.632511 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:49.632780 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:49.633136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:49.634091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] RBAC: Adding query filter params (role.id=47b1d1c854974de186b26368cbda5785, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=83d3b227fbcc4d409c4e168395eb364a) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:49.634409 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:49.635988 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5add01-0d71-4c18-891d-21b249d6f44a None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:49.658714 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 624/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:14:49 2022] GET /identity/v3/role_assignments?user.id=83d3b227fbcc4d409c4e168395eb364a&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=47b1d1c854974de186b26368cbda5785 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:52.069807 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236bc8-67a7-4f16-b663-a9977cdcbb2c None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.070366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236bc8-67a7-4f16-b663-a9977cdcbb2c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.070366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b236bc8-67a7-4f16-b663-a9977cdcbb2c None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.071910 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 623/1247] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:52.077790 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.078230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.078405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.084133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:52.097567 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:52.099183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:52.182670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 625/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:52.212595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236bc8-67a7-4f16-b663-a9977cdcbb2c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:52.239863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:52.338350 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b236bc8-67a7-4f16-b663-a9977cdcbb2c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:52.376193 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:52.377177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.377534 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.377912 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.389353 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:14:52.397644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:52.398923 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:52.400316 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 624/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:52.405366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:52.520803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdc942-d2c4-4d2c-8fb7-8d2a31d20260 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:52.553031 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:52.559032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:52.559828 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.560110 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.560413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.561293 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:52.561595 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:52.563220 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:52.573489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 626/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:52.579532 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:52.673230 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:52.698436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb4fb2-091d-482b-bc9a-47f32f8b5019 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:52.743846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:52.745173 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.745625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.746051 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.759494 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:52.761153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:52.781748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:52.783326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:52.784318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:52.784318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:52.784318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:52.784318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:52.784318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 625/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:52.790088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:52.904358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747205-07f2-4f9f-a460-63f44bf932bf None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:52.944705 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:52.945268 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:52.945551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:52.945831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:52.946576 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:52.946918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:52.948316 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:52.961396 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 627/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:52.968000 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:53.093030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3adcd5-6d90-4abf-838a-8a1fd98aa1f2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:53.126282 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:53.134796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:53.135713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:53.136016 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:53.136369 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:53.145330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:53.146943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:14:53.162202 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:53.163701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:53.164891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 626/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:53.170163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:53.251116 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:53.303694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2be3-a701-405f-9c03-f1b769284ddd None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:53.344959 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:53.345651 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:53.345941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:53.346217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:53.347178 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:53.347529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:53.349288 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:53.371609 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 628/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:14:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:53.377975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:53.502927 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c8552-adf8-4109-a734-1a0567cc3d82 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:53.543700 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:53.544379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:53.544652 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:53.544982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:53.605760 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:53.623379 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:53.625279 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:53.741190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 627/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:14:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:14:53.747486 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:53.865160 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc631-67cf-4c61-a68f-7879025676c2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:53.878950 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:53.904960 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:53.906610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:53.906610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:53.906610 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:53.918230 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:53.919728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:53.940323 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:53.941643 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:53.947667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:53.947667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:53.947667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:53.947667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:53.947667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 629/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:53.948055 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:54.050360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:54.064551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45c363-6813-40e8-a9e3-2d079f2891c1 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:54.099225 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:54.100008 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:54.100203 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:54.100477 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:54.101216 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:54.101525 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:54.103015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:54.115759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 628/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:54.122179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:54.259593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813e14-5c11-478a-b6c6-a1488f9decd2 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:54.294708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:54.295445 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:54.295725 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:54.295999 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] PATH_INFO: `/v3/projects/service` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:54.302896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:54.304345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:14:54.319974 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:54.321264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:14:54.322460 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 630/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:14:54.327842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:54.438000 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4071-288d-4d23-b959-fc4b68f0d0ad None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:54.474406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:54.475577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:54.475577 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:54.475774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] PATH_INFO: `/v3/projects` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:54.476834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:54.477180 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:54.478613 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e647-e1d3-4d5b-a4b8-49fc93110936 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:54.491657 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 629/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:54.500073 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:54.534054 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:54.621356 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50796cd9-4007-40f0-befa-e1ba14cfb59d None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:54.658063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:54.659221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:54.659726 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:54.660202 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:54.661778 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=83d3b227fbcc4d409c4e168395eb364a) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:54.662369 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:54.665075 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c02879-572d-4d64-877c-6aede1adea4d None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:54.674467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 631/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:14:54 2022] GET /identity/v3/role_assignments?user.id=83d3b227fbcc4d409c4e168395eb364a&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:56.907783 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bf03-281f-49d8-8629-ae9b3fd64076 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:56.908656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bf03-281f-49d8-8629-ae9b3fd64076 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:56.908656 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6bf03-281f-49d8-8629-ae9b3fd64076 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:56.910909 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 630/1261] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:14:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:14:56.917340 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:56.918086 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:56.918258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:56.939273 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:14:56.940468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:14:57.014174 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 632/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:14:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:14:57.036924 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6bf03-281f-49d8-8629-ae9b3fd64076 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:57.056300 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:57.170183 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6bf03-281f-49d8-8629-ae9b3fd64076 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:57.210101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:57.210945 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:57.211232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:57.211509 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:57.221845 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:14:57.229954 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:57.231174 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:57.232116 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 631/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:57.237480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:57.256510 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:57.355346 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119380a-3113-4ccb-a652-6d59c7fa5ced None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:57.391149 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c897b-433d-4823-94cc-656242484946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:57.391855 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c897b-433d-4823-94cc-656242484946 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:57.392139 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c897b-433d-4823-94cc-656242484946 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:57.392411 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c897b-433d-4823-94cc-656242484946 None admin] PATH_INFO: `/v3/roles` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:57.393176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c897b-433d-4823-94cc-656242484946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:57.393483 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c897b-433d-4823-94cc-656242484946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:57.394896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c897b-433d-4823-94cc-656242484946 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:57.403117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 633/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:57.412361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:57.481485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:57.517005 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824446-4f9d-4d43-9a37-13ebdb5bb994 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:57.552000 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:57.552868 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:57.553153 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:57.553432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:57.565359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:57.566866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:57.585774 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:57.586973 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:57.588119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:57.588119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:57.588119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:57.588119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:57.588119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 632/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:57.593762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c897b-433d-4823-94cc-656242484946 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:57.686384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:57.712972 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c897b-433d-4823-94cc-656242484946 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:57.748140 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:57.748727 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:57.749006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:57.749278 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:57.750006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:57.750408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:57.751816 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:57.763706 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 634/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:57.772349 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:57.885453 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfacc04-86fb-495e-a99d-5c40e8c756c5 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:57.905362 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:57.925599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:57.926412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:57.926720 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:57.927007 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:57.934806 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:57.936274 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:14:57.950795 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:57.951943 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:57.953013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 633/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:57.958048 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.065043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309353d-f607-4af8-b5bc-6a2a1c62d509 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:58.101050 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:58.101730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:58.102017 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:58.102291 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] PATH_INFO: `/v3/users` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:58.103179 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:58.103491 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:58.104933 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:58.113672 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:58.123128 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 635/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:14:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:14:58.131092 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.240792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5577b-0fa4-422b-8a65-3a2683e755d2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:58.276682 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:58.277470 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:58.277753 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:58.278024 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:58.289458 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:58.290926 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:14:58.308257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:58.309367 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:58.310852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:14:58.310852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:14:58.310852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:14:58.310852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:58.310852 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 634/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:58.317192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.430377 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44433f-0598-4b23-8603-318428c5b2a6 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:58.465271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:58.465943 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:58.466223 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:58.466494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:58.467257 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:58.467557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:58.468973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:58.482534 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 636/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:14:58.488543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.521639 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:58.602918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce08c4-cc98-4564-864f-07a8ea4ff433 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:58.640213 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:58.641009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:58.641293 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:58.641606 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:58.648597 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:58.650049 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:14:58.664748 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:14:58.665917 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:14:58.667585 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 635/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:14:58.675514 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.757118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:58.807624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddf7b7-b4fe-4e07-b36f-80dbc47f0e91 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:58.847493 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:58.848821 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:58.849271 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:58.849737 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:58.850561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:14:58.850900 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:58.852376 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0c4de-40df-447c-a41c-e5df14da181c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:58.865494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 637/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:14:58.871616 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:14:58.971633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:14:58.987217 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe5b7-49fd-4c44-b7ad-f602e444b7ec None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:14:59.036828 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:14:59.037794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] REQUEST_METHOD: `PUT` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:14:59.038082 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:14:59.038360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] PATH_INFO: `/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/83d3b227fbcc4d409c4e168395eb364a/roles/3d4222f61d774512b154900643156352` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:14:59.040506 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] RBAC: Authorizing `identity:create_grant(project_id=61d33ddd0c42459bbcf2bc3d88c4e107, user_id=83d3b227fbcc4d409c4e168395eb364a, role_id=3d4222f61d774512b154900643156352)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:14:59.042004 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1fb76-7e74-449c-8dad-1f7126b50760 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:14:59.064711 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 636/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:14:58 2022] PUT /identity/v3/projects/61d33ddd0c42459bbcf2bc3d88c4e107/users/83d3b227fbcc4d409c4e168395eb364a/roles/3d4222f61d774512b154900643156352 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:15:01.262555 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ea07-19d2-44be-a032-063affa2e6ee None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.263156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ea07-19d2-44be-a032-063affa2e6ee None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.263156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90ea07-19d2-44be-a032-063affa2e6ee None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.264578 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 638/1274] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:01.271063 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.271796 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.271953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.295637 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:01.296849 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:01.379310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 637/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:15:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:15:01.402988 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ea07-19d2-44be-a032-063affa2e6ee None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:01.512228 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90ea07-19d2-44be-a032-063affa2e6ee None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:01.530826 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:01.556196 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:01.557002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.557283 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.557554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.569018 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:15:01.576617 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:01.577735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:01.579097 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 639/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:01.584146 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:01.671866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:01.691984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acd61b-20a2-4255-b30e-02f33015d95f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:01.727310 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:01.727975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.728255 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.728528 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.729291 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:01.729595 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:01.731009 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:01.739578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 638/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:01.745640 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:01.847712 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb33236-09f5-4fba-b75e-45ad7fb60345 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:01.882731 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:01.883552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:01.883829 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:01.884109 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:01.895199 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:01.896709 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:15:01.913964 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:01.915074 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:01.916264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:15:01.916264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:15:01.916264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:15:01.916264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:01.916264 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 640/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:01.921044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:02.033444 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90f6a3-52b3-41d8-953d-5464266ad1a2 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:02.069599 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:02.070253 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:02.070538 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:02.070844 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] PATH_INFO: `/v3/domains` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:02.071578 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:02.071886 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:02.073267 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:02.085284 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 639/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:02.093871 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:02.133941 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:02.210942 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c4c3-faf3-43f5-9387-22fdda498a9e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:02.246735 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:02.247557 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:02.247839 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:02.248117 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:02.255529 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:02.257002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:15:02.271717 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:02.273427 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:02.274622 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 641/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:15:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:02.279654 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:02.284113 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:02.389375 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fd9ac-58a1-4584-9a34-b7483b711f3a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:02.428277 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:02.429252 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:02.429541 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:02.429824 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] PATH_INFO: `/v3/users` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:02.430718 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:02.431045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:02.432551 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:02.449317 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 640/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:15:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:15:02.455413 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:02.557607 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:02.567870 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ca26-b1ab-4d89-bfd8-7cc7497cab3e None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:02.606708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:02.608344 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:02.609138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:02.609658 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:02.699343 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:02.700751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:02.812421 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:02.823670 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 642/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:15:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:15:02.833388 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:02.906132 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:02.945930 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605316c5-bf11-47f8-95f3-59bc32c21a5c None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:02.982018 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:02.982728 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:02.983046 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:02.983318 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:02.993850 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:02.995352 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:15:03.013331 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:03.014503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:03.015574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:15:03.015574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:15:03.015574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:15:03.015574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:15:03.015574 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 641/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:03.022899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:03.142088 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103295d5-af00-4010-980d-647cb3b10fd1 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:03.179490 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:03.180156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:03.180439 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:03.180714 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] PATH_INFO: `/v3/domains` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:03.181452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:03.181760 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:03.183182 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:03.194763 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 643/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:03.200744 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:03.315112 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869707-8813-44c6-a492-35479fd36b9a None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:03.330953 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:03.352834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:03.353628 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:03.353911 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:03.354190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:03.361341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:03.362858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:15:03.376785 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application with Lock( May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:03.378045 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: ERROR keystone.server.flask.application May 19 20:15:03.379455 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 642/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:03.384399 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:03.434359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:03.487468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4615c45-7fe7-411c-be2f-81a9e30508e7 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:03.524488 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:03.525148 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:03.525463 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:03.525740 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] PATH_INFO: `/v3/projects` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:03.526548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:03.526898 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:03.528348 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737446c-043a-461a-bda0-6fe4af303338 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:03.541191 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 644/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:03.547767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:03.658724 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281557d4-2782-4ca5-94bb-c39f27c3c226 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:03.694710 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:03.695365 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:03.695646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:03.695920 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:03.696767 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] RBAC: Adding query filter params (role.id=3d4222f61d774512b154900643156352, scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107, user.id=83d3b227fbcc4d409c4e168395eb364a) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:03.697078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:03.698492 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d804832-efe1-4024-99e1-e9aa1503b86c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:03.704759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 643/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:15:03 2022] GET /identity/v3/role_assignments?user.id=83d3b227fbcc4d409c4e168395eb364a&scope.project.id=61d33ddd0c42459bbcf2bc3d88c4e107&role.id=3d4222f61d774512b154900643156352 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:05.934498 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280c63-5f84-463b-ba4c-f1202f8f8b49 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:05.935467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280c63-5f84-463b-ba4c-f1202f8f8b49 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:05.935467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280c63-5f84-463b-ba4c-f1202f8f8b49 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:05.937568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 645/1288] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:15:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:05.945608 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:05.946084 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:05.946195 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:05.964326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:05.965503 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:05.996227 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:06.037154 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 644/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:15:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:15:06.059981 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280c63-5f84-463b-ba4c-f1202f8f8b49 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:06.192107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280c63-5f84-463b-ba4c-f1202f8f8b49 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:06.206107 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:06.233280 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:06.234087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:06.234390 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:06.234644 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] PATH_INFO: `/v3/services/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:06.235347 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:06.236730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:06.248925 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:06.250461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:06.251696 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 646/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:15:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:06.256740 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:06.368044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561527c-fcbe-4233-a72e-43e84f1f242c None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:06.404756 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:06.405416 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:06.405708 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:06.405985 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:06.406731 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] RBAC: Adding query filter params (name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:06.407044 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:06.408432 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b8079-3f92-452e-906b-d8d4e520248c None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:06.413721 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 645/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:15:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:06.419668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:06.531831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191d444-2a58-4bfe-a347-3ff5636a7151 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:06.569142 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:06.569806 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:06.570090 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:06.570370 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] PATH_INFO: `/v3/services` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:06.571127 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] RBAC: Adding query filter params (type=placement) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:06.571438 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:06.572861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6b48d-ea6f-43c1-8769-aba6a9913864 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:06.577567 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 647/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:15:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:08.764208 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a898ca-f64d-4b8d-9499-477811e32d3e None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:08.764794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a898ca-f64d-4b8d-9499-477811e32d3e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:08.764794 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a898ca-f64d-4b8d-9499-477811e32d3e None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:08.766079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 646/1293] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:08.772656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8d83-1838-45f4-9156-382ced9a828e None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:08.773388 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8d83-1838-45f4-9156-382ced9a828e None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:08.773580 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a8d83-1838-45f4-9156-382ced9a828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:08.795965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-522a8d83-1838-45f4-9156-382ced9a828e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:08.797150 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-522a8d83-1838-45f4-9156-382ced9a828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:08.827728 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:08.871384 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 648/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:15:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:15:08.904655 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a898ca-f64d-4b8d-9499-477811e32d3e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:08.938491 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:09.032188 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a898ca-f64d-4b8d-9499-477811e32d3e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:09.067627 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:09.068285 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:09.068567 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:09.068837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:09.069570 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:09.070975 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2309f50-16d0-4f3d-8dc1-79800c9bf881 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:09.087705 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 647/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:15:08 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:15:11.294301 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd629-0505-469c-a6c4-a27ce9229279 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.294970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd629-0505-469c-a6c4-a27ce9229279 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.294970 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd629-0505-469c-a6c4-a27ce9229279 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.296924 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 649/1296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:11.308049 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.308500 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.310323 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.329834 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:11.331077 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:11.409065 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 648/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:15:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:15:11.433126 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd629-0505-469c-a6c4-a27ce9229279 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:11.547065 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd629-0505-469c-a6c4-a27ce9229279 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:11.597551 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:11.598667 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.598986 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.599338 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] PATH_INFO: `/v3/services/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.600006 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:11.601408 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:11.613745 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:11.614947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:11.616574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 650/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:15:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:11.624856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:11.646815 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:11.730765 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfc02-772f-4756-82f3-accaf58bfb5f None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:11.775406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:11.776062 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.776350 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.776625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.777341 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:11.777645 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:11.779066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:11.784853 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 649/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:15:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:11.791762 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:11.837292 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:11.911032 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29ce58-ca8b-4b57-9529-eb3b33a37709 None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:11.948067 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:11.948709 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:11.948991 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:11.949260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:11.950059 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] RBAC: Adding query filter params (interface=public, service_id=f64756d3e9f84d408becea3eaa765d0d, region_id=RegionOne) {{(pid=207426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:11.950366 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:11.951768 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede44e4-5e3c-42b5-a83f-b174439dd96c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:11.957008 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 651/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:15:11 2022] GET /identity/v3/endpoints?service_id=f64756d3e9f84d408becea3eaa765d0d&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:11.966064 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:12.059760 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:12.079858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e5470-e639-4eed-91d0-71b320f23c88 None admin] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:12.117103 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:12.117699 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:12.117982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:12.118258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:12.118988 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:12.120436 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1e4e0-489c-477f-89b4-8b0639b78917 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:12.127421 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 650/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:15:11 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:15:14.346211 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b249ac-0344-4e7d-a06a-e449d86c884c None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:14.346847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b249ac-0344-4e7d-a06a-e449d86c884c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:14.346847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b249ac-0344-4e7d-a06a-e449d86c884c None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:14.348523 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 652/1302] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:15:14.355190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:14.355935 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:14.356122 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:14.378572 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:15:14.379818 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:15:14.451722 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 651/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:15:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:15:14.482071 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b249ac-0344-4e7d-a06a-e449d86c884c None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:14.587599 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:14.595130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b249ac-0344-4e7d-a06a-e449d86c884c None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:14.630480 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:14.631313 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:14.631596 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:14.631875 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] PATH_INFO: `/v3/services/placement` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:14.632542 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:14.633934 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:15:14.646156 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:15:14.647526 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application with Lock( May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self._enter() May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application return self.creator() May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application created_value = creator( May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: ERROR keystone.server.flask.application May 19 20:15:14.649243 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 653/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:15:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:15:14.657190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:14.745936 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:14.785339 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec82f4-58a3-4c85-b9ff-12309665432e None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:14.824562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:14.825232 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:14.825520 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:14.825800 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] PATH_INFO: `/v3/services` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:14.826536 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] RBAC: Adding query filter params (name=placement) {{(pid=207425) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:15:14.826880 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:14.828307 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118a60f-ba96-45c4-809b-bb1184695673 None admin] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:14.833761 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 652/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:15:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:15:14.843089 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:15:14.952064 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a1174-6c57-4566-8cf5-f7c80995639c None admin] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:15:14.997461 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a341201fe78a44788ba60279420a0db2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:15:14.998124 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:15:14.998414 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:15:14.998720 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:15:14.999475 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:15:15.000867 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a5aac-2e0d-4965-9583-ad1b53e08a14 None admin] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:15:15.024154 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 654/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:15:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:15:24.830526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=30 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:15:25.019345 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:21.410211 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a28b-613d-4222-b32f-e3ea2cd4646b None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:21.411366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a28b-613d-4222-b32f-e3ea2cd4646b None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:21.412060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02a28b-613d-4222-b32f-e3ea2cd4646b None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:21.415035 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 653/1307] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:21.422176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b300-8861-47d5-a575-0f30cf6c211c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:21.423121 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b300-8861-47d5-a575-0f30cf6c211c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:21.423564 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b300-8861-47d5-a575-0f30cf6c211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:21.591138 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-b093b300-8861-47d5-a575-0f30cf6c211c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:21.592415 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-b093b300-8861-47d5-a575-0f30cf6c211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:21.811947 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 655/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:21.878040 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:21.878621 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:21.879083 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:21.880872 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 654/1309] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:21.897864 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b9dfd-651f-427b-8fa4-03c2c60c21d1 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:21.898463 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b9dfd-651f-427b-8fa4-03c2c60c21d1 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:21.898929 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b9dfd-651f-427b-8fa4-03c2c60c21d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:22.047608 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-888b9dfd-651f-427b-8fa4-03c2c60c21d1 None None] MFA Rules not processed for user `74e758c81d1a49f98826472746ae9e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:22.049087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-888b9dfd-651f-427b-8fa4-03c2c60c21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:22.090050 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:22.205242 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 656/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:16:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:22.206309 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:22.208212 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:22.441060 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed243b-e1c2-4587-af3d-b36bef00ad52 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:22.596695 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:22.597280 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:22.597561 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:22.597833 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:22.600078 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:22.669143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:22.787079 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:22.788684 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3eec0-c80d-4ab1-a29f-87e16bb42429 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:22.823681 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 655/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:25.664309 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:25.664896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:25.664896 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:25.666431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 657/1312] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:25.671675 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024fed-799f-4177-b5d8-e5dfdf9f2d14 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:25.672101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024fed-799f-4177-b5d8-e5dfdf9f2d14 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:25.672337 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81024fed-799f-4177-b5d8-e5dfdf9f2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:25.768875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-81024fed-799f-4177-b5d8-e5dfdf9f2d14 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:25.770258 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-81024fed-799f-4177-b5d8-e5dfdf9f2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:25.884308 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 656/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:25.923123 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:25.924869 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:26.041225 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af22f6-ba3b-455f-87b5-78c727cb8391 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:26.115996 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:26.119070 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:26.120358 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:26.120723 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:26.121068 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:26.123440 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:26.241694 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:26.243183 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9718dc-0f40-4c55-a138-9e86386a25ab service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:26.264521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 658/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:28.849425 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:28.849966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:28.849966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:28.851326 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 657/1315] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:28.856990 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b87d5-be39-48ae-9dc5-cf378cf31d42 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:28.857471 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b87d5-be39-48ae-9dc5-cf378cf31d42 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:28.857568 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b87d5-be39-48ae-9dc5-cf378cf31d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:28.932013 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-cc9b87d5-be39-48ae-9dc5-cf378cf31d42 None None] MFA Rules not processed for user `1154fafd1d0b4e98bf95cfa4d6a10d05`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:28.933226 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-cc9b87d5-be39-48ae-9dc5-cf378cf31d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:28.994897 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:29.048063 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 659/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:29.090884 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:29.093411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:29.110359 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:29.211344 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5369cb-2646-4eca-a948-39bfad52e313 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:29.294772 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:29.295441 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:29.295714 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:29.295986 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:29.297665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:29.376543 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:29.436730 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:29.438187 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b402c8-9e59-45b6-a0c0-9c25e3051a48 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:29.458521 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 658/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:32.284750 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:32.285436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:32.285436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:32.287655 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 660/1318] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:32.294187 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e331-db40-43fb-9e80-03615093bb63 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:32.294633 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e331-db40-43fb-9e80-03615093bb63 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:32.294997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e331-db40-43fb-9e80-03615093bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:32.365982 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-2e14e331-db40-43fb-9e80-03615093bb63 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:32.367210 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2e14e331-db40-43fb-9e80-03615093bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:32.465228 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 659/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:32.503753 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:32.505433 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:32.616831 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24067b04-364f-411d-bd01-18b3c78bbbae None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:32.704911 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:32.705574 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:32.705861 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:32.706136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:32.707853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:32.716096 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:32.833108 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:32.834572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9537-12a7-4717-9d58-6edfa562f116 service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:32.854637 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 661/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:35.798015 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc773-635a-4984-b7a0-69dc703a02e5 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:35.798592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc773-635a-4984-b7a0-69dc703a02e5 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:35.798592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc773-635a-4984-b7a0-69dc703a02e5 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:35.800110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 660/1321] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:35.805771 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516cea-2d7f-49ef-a637-24d8fb4e34c8 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:35.806223 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516cea-2d7f-49ef-a637-24d8fb4e34c8 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:35.806470 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516cea-2d7f-49ef-a637-24d8fb4e34c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:35.875166 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-cf516cea-2d7f-49ef-a637-24d8fb4e34c8 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:35.876386 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-cf516cea-2d7f-49ef-a637-24d8fb4e34c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:35.932122 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:35.971036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 662/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:36.021368 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:36.021758 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:36.022143 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:36.023659 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 661/1323] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:36.030040 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac15-3fd5-4a71-b75d-1f239e6c1e4c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:36.030317 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac15-3fd5-4a71-b75d-1f239e6c1e4c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:36.030593 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0ac15-3fd5-4a71-b75d-1f239e6c1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:36.109540 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-95f0ac15-3fd5-4a71-b75d-1f239e6c1e4c None None] MFA Rules not processed for user `74e758c81d1a49f98826472746ae9e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:36.110665 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-95f0ac15-3fd5-4a71-b75d-1f239e6c1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:36.192387 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 663/1324] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:16:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:36.201518 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:36.203251 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:36.225145 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:36.315066 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc60231-7ab0-47aa-bffa-e6630ef175e0 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:36.393190 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:36.393856 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:36.394141 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:36.394418 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:36.396134 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:36.470485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:36.513412 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:36.514918 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6baa1e-1bc8-41ec-b60b-9bd634c1f1c9 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:36.534177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 662/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:39.016845 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:39.017450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:39.017450 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:39.018812 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 664/1326] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:39.024484 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f22aa-e180-4f95-9faa-45ad78c0c248 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:39.024929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f22aa-e180-4f95-9faa-45ad78c0c248 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:39.025101 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f22aa-e180-4f95-9faa-45ad78c0c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:39.093453 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c71f22aa-e180-4f95-9faa-45ad78c0c248 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:39.094665 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c71f22aa-e180-4f95-9faa-45ad78c0c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:39.196497 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 663/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:39.232601 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:39.234261 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:39.297078 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:39.342521 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046f95c-3432-43e5-82ac-5648561621aa None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:39.416087 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:39.416752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:39.417036 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:39.417304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:39.419030 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:39.547272 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:39.549668 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:39.552331 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da7fc6-0f8c-41eb-adb9-381804e46894 service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:39.572892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 665/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:41.853038 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:41.853511 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:41.853623 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:41.855239 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 664/1329] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:41.861522 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d9cd-c59b-44c7-9d1a-69cbce3d667b None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:41.862303 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d9cd-c59b-44c7-9d1a-69cbce3d667b None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:41.862481 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030d9cd-c59b-44c7-9d1a-69cbce3d667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:41.932847 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9030d9cd-c59b-44c7-9d1a-69cbce3d667b None None] MFA Rules not processed for user `1154fafd1d0b4e98bf95cfa4d6a10d05`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:41.934105 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9030d9cd-c59b-44c7-9d1a-69cbce3d667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:42.035730 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 666/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:42.072837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:42.074385 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:42.109177 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:42.196899 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2f2e-5f31-411c-906c-4c00e03c212a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:42.272481 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:42.273117 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:42.273399 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:42.273672 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:42.275360 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:42.356068 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:42.398861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:42.400332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfd13f-56c2-47f7-9427-032836dd2c1d service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:42.419900 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 665/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:45.045715 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47844-4f74-4021-acea-a40629510528 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:45.046591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47844-4f74-4021-acea-a40629510528 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:45.046591 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb47844-4f74-4021-acea-a40629510528 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:45.048879 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 667/1332] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:45.056254 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af731-fbe3-4921-8800-db78c15397cb None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:45.056680 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af731-fbe3-4921-8800-db78c15397cb None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:45.056874 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1af731-fbe3-4921-8800-db78c15397cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:45.143010 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-4e1af731-fbe3-4921-8800-db78c15397cb None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:45.144257 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-4e1af731-fbe3-4921-8800-db78c15397cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:45.253539 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 666/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:45.289556 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb47844-4f74-4021-acea-a40629510528 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:45.291163 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-ecb47844-4f74-4021-acea-a40629510528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:45.367741 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:45.404541 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb47844-4f74-4021-acea-a40629510528 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:45.487405 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:45.488091 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:45.488359 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:45.488633 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:45.490328 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:45.620770 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:45.622136 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7542e-65dd-427d-b5ff-eabdf34a7c7e service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:45.632548 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:45.643002 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 668/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:47.922400 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:47.922984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:47.922984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:47.924394 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 667/1335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:47.930231 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f35e-af57-48e0-b50a-808d70a13110 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:47.930892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f35e-af57-48e0-b50a-808d70a13110 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:47.930892 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9f35e-af57-48e0-b50a-808d70a13110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:48.004899 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-59e9f35e-af57-48e0-b50a-808d70a13110 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:48.006552 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-59e9f35e-af57-48e0-b50a-808d70a13110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:48.120368 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 669/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:48.173658 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:48.176144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:48.234348 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:48.306737 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeeee6-7f09-4026-82c5-a90a22784779 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:48.392194 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:48.392861 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:48.393150 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:48.393424 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:48.395148 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:48.484475 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:48.516030 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:48.517496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca084118-06bd-4efc-81a4-e2ac9e6e0fc7 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:48.536171 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 668/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:51.213654 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa897-3554-458f-8d11-10375352952f None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:51.214304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa897-3554-458f-8d11-10375352952f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:51.214304 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aa897-3554-458f-8d11-10375352952f None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:51.215640 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 670/1338] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:51.221215 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8e92-a482-46fe-bd14-06e0601ce821 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:51.221682 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8e92-a482-46fe-bd14-06e0601ce821 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:51.221786 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8e92-a482-46fe-bd14-06e0601ce821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:51.294725 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-11ba8e92-a482-46fe-bd14-06e0601ce821 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:51.295971 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-11ba8e92-a482-46fe-bd14-06e0601ce821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:51.408928 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 669/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:51.445918 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aa897-3554-458f-8d11-10375352952f None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:51.450312 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-106aa897-3554-458f-8d11-10375352952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:51.555014 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:51.590234 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aa897-3554-458f-8d11-10375352952f None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:51.649803 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:51.650447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:51.650710 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:51.651021 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:51.652688 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:51.769061 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:51.770467 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ee97d-4e4d-48c5-9cbc-4375ce3c54f1 service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:51.791305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 671/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:16:56.147956 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:56.148562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:56.148562 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:56.149875 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 670/1341] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:56.155436 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af721-9897-4734-965a-649183ed9b5c None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:56.155865 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af721-9897-4734-965a-649183ed9b5c None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:56.156010 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555af721-9897-4734-965a-649183ed9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:56.203965 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-555af721-9897-4734-965a-649183ed9b5c None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:56.205064 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-555af721-9897-4734-965a-649183ed9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:56.208305 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=100 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:16:56.285704 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 672/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:56.324505 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:56.326846 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:56.350842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc980f-df37-46e6-9249-62d8021cefdc None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:56.354465 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:56.355135 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:56.355417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:56.355688 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:56.365119 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:56.366553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929476fc-da92-4b45-8bae-cd8f0216aa54 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:56.376265 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 671/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:16:59.208494 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c94b6-115f-4621-af6e-36c216319bfd None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:59.209100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c94b6-115f-4621-af6e-36c216319bfd None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:59.209100 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c94b6-115f-4621-af6e-36c216319bfd None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:59.210624 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 673/1344] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:16:59.216013 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a9a2-2722-4ede-93a9-964fbac2369f None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:59.216488 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a9a2-2722-4ede-93a9-964fbac2369f None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:59.216592 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a9a2-2722-4ede-93a9-964fbac2369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:59.246241 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-f088a9a2-2722-4ede-93a9-964fbac2369f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:16:59.247397 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-f088a9a2-2722-4ede-93a9-964fbac2369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:16:59.255526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 672/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:16:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:16:59.292931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c94b6-115f-4621-af6e-36c216319bfd None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:16:59.304391 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c94b6-115f-4621-af6e-36c216319bfd None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:16:59.308043 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:16:59.308690 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:16:59.308980 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:16:59.309258 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:16:59.318489 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:16:59.319978 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab6fdb-a413-43b1-9f78-b4e8644ad9d0 service neutron] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:16:59.329590 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 674/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:16:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:17:03.594298 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4b8e-ff3c-4cf7-9581-2a09970b415a None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:03.594866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4b8e-ff3c-4cf7-9581-2a09970b415a None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:03.594866 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b4b8e-ff3c-4cf7-9581-2a09970b415a None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:03.596268 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 673/1347] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:03.602217 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d1b2-978a-421c-882b-2166e452986f None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:03.602656 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d1b2-978a-421c-882b-2166e452986f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:03.602792 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d1b2-978a-421c-882b-2166e452986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:03.622296 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-9467d1b2-978a-421c-882b-2166e452986f None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:03.623536 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-9467d1b2-978a-421c-882b-2166e452986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:03.633192 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 675/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:03.671209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4b8e-ff3c-4cf7-9581-2a09970b415a None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:17:03.682842 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b4b8e-ff3c-4cf7-9581-2a09970b415a None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:17:03.686581 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e758c81d1a49f98826472746ae9e1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:17:03.687272 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:03.687553 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:03.687826 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:03.693771 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:17:03.697744 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:17:03.699701 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebe040-fd7f-4519-8875-562cb104e7c6 service neutron] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:17:03.709759 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 674/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:17:09.104120 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eebcd-cc70-495f-90e8-973b67916390 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:09.104572 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eebcd-cc70-495f-90e8-973b67916390 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:09.104719 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eebcd-cc70-495f-90e8-973b67916390 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:09.106532 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 676/1350] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:17:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:09.111837 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1583-8230-4056-b695-775cab10b1cb None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:09.112248 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1583-8230-4056-b695-775cab10b1cb None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:09.112398 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1583-8230-4056-b695-775cab10b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:09.186115 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-67ec1583-8230-4056-b695-775cab10b1cb None None] MFA Rules not processed for user `83d3b227fbcc4d409c4e168395eb364a`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:09.187466 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-67ec1583-8230-4056-b695-775cab10b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:09.274096 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 675/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:17:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:17:13.616801 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=39 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:17:13.662708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88eda-9187-4065-9383-c4e82912165f None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:13.662708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88eda-9187-4065-9383-c4e82912165f None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:13.662708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88eda-9187-4065-9383-c4e82912165f None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:13.662708 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 677/1352] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:13.667897 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b0e2-598d-4d10-82ec-feef84fe5d9d None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:13.668406 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b0e2-598d-4d10-82ec-feef84fe5d9d None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:13.668997 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b0e2-598d-4d10-82ec-feef84fe5d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:13.688196 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-32c3b0e2-598d-4d10-82ec-feef84fe5d9d None None] MFA Rules not processed for user `83d3b227fbcc4d409c4e168395eb364a`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:13.689566 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-32c3b0e2-598d-4d10-82ec-feef84fe5d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:13.699019 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 676/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:17:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:15.301647 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9035-78b4-4411-960b-bd1a8bd94605 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:15.302269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9035-78b4-4411-960b-bd1a8bd94605 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:15.302269 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf9035-78b4-4411-960b-bd1a8bd94605 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:15.303752 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 678/1354] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:15.308840 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddda4f-e91a-4af4-8173-a53454e85e45 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:15.309264 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddda4f-e91a-4af4-8173-a53454e85e45 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:15.309410 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddda4f-e91a-4af4-8173-a53454e85e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:15.328411 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-72ddda4f-e91a-4af4-8173-a53454e85e45 None None] MFA Rules not processed for user `83d3b227fbcc4d409c4e168395eb364a`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:15.329591 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-72ddda4f-e91a-4af4-8173-a53454e85e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:15.339113 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 677/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:17:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:17:19.243849 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2a93-7642-41b5-ba8d-85d84360d025 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:19.244496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2a93-7642-41b5-ba8d-85d84360d025 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:19.244496 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d2a93-7642-41b5-ba8d-85d84360d025 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:19.246046 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 679/1356] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:19.251631 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac4983-a3b8-43f7-b978-6fafe9100e61 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:19.252479 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac4983-a3b8-43f7-b978-6fafe9100e61 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:19.253041 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac4983-a3b8-43f7-b978-6fafe9100e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:19.271332 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-69ac4983-a3b8-43f7-b978-6fafe9100e61 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:19.272729 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-69ac4983-a3b8-43f7-b978-6fafe9100e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:19.281129 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 678/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:19.342119 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9da5-5398-43ed-b0e6-e30cb46691ff None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:19.342868 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9da5-5398-43ed-b0e6-e30cb46691ff None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:19.343401 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa9da5-5398-43ed-b0e6-e30cb46691ff None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:19.345170 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 680/1358] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:17:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:19.356142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a436b8-3948-40b3-9a75-b62648fd81e1 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:19.357840 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a436b8-3948-40b3-9a75-b62648fd81e1 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:19.358984 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a436b8-3948-40b3-9a75-b62648fd81e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:19.419987 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-34a436b8-3948-40b3-9a75-b62648fd81e1 None None] MFA Rules not processed for user `c7e4a6850d01483b9f9c5ceabd562d91`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:19.421214 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-34a436b8-3948-40b3-9a75-b62648fd81e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:19.475186 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=100 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:17:19.511209 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 679/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:17:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:19.519516 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa9da5-5398-43ed-b0e6-e30cb46691ff None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:17:19.537853 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa9da5-5398-43ed-b0e6-e30cb46691ff None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:17:19.543836 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e4a6850d01483b9f9c5ceabd562d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:17:19.544744 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:19.545221 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:19.545487 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:19.554274 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:17:19.556392 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc399a-0c97-4219-b438-7b90a1c9f8f0 service nova] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:17:19.565825 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 681/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 20:17:21.982220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd28-4de5-4ffc-a4c0-6836fbd167c5 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:21.982220 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd28-4de5-4ffc-a4c0-6836fbd167c5 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:21.982850 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5cd28-4de5-4ffc-a4c0-6836fbd167c5 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:21.983863 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 680/1361] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:21.989646 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086f70-9d88-459d-9ba4-b7d45cad4ea9 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:21.990130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086f70-9d88-459d-9ba4-b7d45cad4ea9 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:21.990241 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086f70-9d88-459d-9ba4-b7d45cad4ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:22.008891 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-60086f70-9d88-459d-9ba4-b7d45cad4ea9 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:22.010133 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-60086f70-9d88-459d-9ba4-b7d45cad4ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:22.018973 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 682/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:22.066340 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cd28-4de5-4ffc-a4c0-6836fbd167c5 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:17:22.082625 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5cd28-4de5-4ffc-a4c0-6836fbd167c5 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:17:22.089266 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e4a6850d01483b9f9c5ceabd562d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:17:22.089966 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:22.090250 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:22.090523 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:22.100496 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:17:22.102142 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5aa5b-2c56-4cb1-becc-68ccf7ec6b36 service nova] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:17:22.112234 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 681/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:17:24.656887 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523cff-dbd4-4117-a840-b102c8ab2d23 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:24.657452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523cff-dbd4-4117-a840-b102c8ab2d23 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:24.657452 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6523cff-dbd4-4117-a840-b102c8ab2d23 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:24.659137 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 683/1364] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:17:24.664713 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ab954-de7d-43a0-991f-33579d7535dd None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:24.665144 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ab954-de7d-43a0-991f-33579d7535dd None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:24.665330 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ab954-de7d-43a0-991f-33579d7535dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:24.686242 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-8d5ab954-de7d-43a0-991f-33579d7535dd None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:24.687526 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-8d5ab954-de7d-43a0-991f-33579d7535dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:24.696891 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 682/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:24.743765 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851e898-109b-4057-98e9-7c0deea9c166 None None] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:24.744118 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851e898-109b-4057-98e9-7c0deea9c166 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:24.744705 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851e898-109b-4057-98e9-7c0deea9c166 None None] PATH_INFO: `/` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:24.746198 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 684/1366] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:24.752452 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648ef5-d5cf-4112-aefc-ace35ab918e9 None None] REQUEST_METHOD: `POST` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:24.752727 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648ef5-d5cf-4112-aefc-ace35ab918e9 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:24.753057 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6648ef5-d5cf-4112-aefc-ace35ab918e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:24.772163 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.auth.core [None req-c6648ef5-d5cf-4112-aefc-ace35ab918e9 None None] MFA Rules not processed for user `c7e4a6850d01483b9f9c5ceabd562d91`. Rule list: `[]` (Enabled: `True`). {{(pid=207425) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:24.773366 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.fernet_utils [None req-c6648ef5-d5cf-4112-aefc-ace35ab918e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207425) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:24.784751 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 683/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:17:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:24.796219 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851e898-109b-4057-98e9-7c0deea9c166 None None] Authenticating user token {{(pid=207426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:17:24.811642 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851e898-109b-4057-98e9-7c0deea9c166 None None] Validating token access rules against request {{(pid=207426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:17:24.817468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e4a6850d01483b9f9c5ceabd562d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:17:24.818186 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] REQUEST_METHOD: `GET` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:24.818537 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:24.818907 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:24.827751 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:17:24.829431 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce95b49-c39f-4af5-a1ad-3500bd1d569b service nova] RBAC: Authorization granted {{(pid=207426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:17:24.839561 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 685/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:17:25.648781 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754fb9-6102-4f35-8d16-93d58269b4cf None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:25.649501 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754fb9-6102-4f35-8d16-93d58269b4cf None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:25.649843 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de754fb9-6102-4f35-8d16-93d58269b4cf None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:25.651462 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 684/1369] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:25.656926 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696d07-6d12-4192-a38b-92eb21902a92 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:25.657448 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696d07-6d12-4192-a38b-92eb21902a92 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:25.657554 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696d07-6d12-4192-a38b-92eb21902a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:25.678447 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-b6696d07-6d12-4192-a38b-92eb21902a92 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:25.679931 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-b6696d07-6d12-4192-a38b-92eb21902a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:25.689260 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 686/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:27.139792 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c007-b007-4e9a-8f36-2367b76b07d3 None None] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:27.140431 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c007-b007-4e9a-8f36-2367b76b07d3 None None] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:27.140431 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c007-b007-4e9a-8f36-2367b76b07d3 None None] PATH_INFO: `/` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:27.141739 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 685/1371] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:17:27.147533 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871014-9c34-4904-9daa-3a1fb22f1816 None None] REQUEST_METHOD: `POST` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:27.148014 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871014-9c34-4904-9daa-3a1fb22f1816 None None] SCRIPT_NAME: `/identity` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:27.148131 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871014-9c34-4904-9daa-3a1fb22f1816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:27.167176 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.auth.core [None req-1b871014-9c34-4904-9daa-3a1fb22f1816 None None] MFA Rules not processed for user `a341201fe78a44788ba60279420a0db2`. Rule list: `[]` (Enabled: `True`). {{(pid=207426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:17:27.168477 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG keystone.common.fernet_utils [None req-1b871014-9c34-4904-9daa-3a1fb22f1816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:17:27.177468 dv-cinder-835881-13-smb devstack@keystone.service[207426]: [pid: 207426|app: 0|req: 687/1372] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:17:27.220644 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c007-b007-4e9a-8f36-2367b76b07d3 None None] Authenticating user token {{(pid=207425) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:17:27.236858 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c007-b007-4e9a-8f36-2367b76b07d3 None None] Validating token access rules against request {{(pid=207425) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:17:27.242770 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e4a6850d01483b9f9c5ceabd562d91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d33ddd0c42459bbcf2bc3d88c4e107', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207425) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:17:27.243361 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] REQUEST_METHOD: `GET` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:17:27.243646 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] SCRIPT_NAME: `/identity` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:17:27.243929 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207425) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:17:27.252417 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:17:27.254110 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb70a3-ab51-4920-8e85-f4a52db65140 service nova] RBAC: Authorization granted {{(pid=207425) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:17:27.263600 dv-cinder-835881-13-smb devstack@keystone.service[207425]: [pid: 207425|app: 0|req: 686/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:17:37.161858 dv-cinder-835881-13-smb devstack@keystone.service[207426]: DEBUG dbcounter [-] [207426] Writing DB stats keystone:SELECT=21 {{(pid=207426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:17:37.259485 dv-cinder-835881-13-smb devstack@keystone.service[207425]: DEBUG dbcounter [-] [207425] Writing DB stats keystone:SELECT=31 {{(pid=207425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:17:49.525866 dv-cinder-835881-13-smb devstack@keystone.service[207413]: Thu May 19 20:17:49 2022 - graceful shutdown triggered... May 19 20:17:49.526192 dv-cinder-835881-13-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:17:49.526619 dv-cinder-835881-13-smb devstack@keystone.service[207425]: Gracefully killing worker 1 (pid: 207425)... May 19 20:17:49.527130 dv-cinder-835881-13-smb devstack@keystone.service[207426]: Gracefully killing worker 2 (pid: 207426)... May 19 20:17:50.527819 dv-cinder-835881-13-smb devstack@keystone.service[207413]: worker 1 buried after 1 seconds May 19 20:17:50.527819 dv-cinder-835881-13-smb devstack@keystone.service[207413]: worker 2 buried after 1 seconds May 19 20:17:50.527819 dv-cinder-835881-13-smb devstack@keystone.service[207413]: goodbye to uWSGI. May 19 20:17:50.529800 dv-cinder-835881-13-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:17:50.530485 dv-cinder-835881-13-smb systemd[1]: Stopped Devstack devstack@keystone.service. May 19 20:23:48.054264 dv-cinder-835881-13-smb systemd[1]: Starting Devstack devstack@keystone.service... May 19 20:23:48.061891 dv-cinder-835881-13-smb devstack@keystone.service[270812]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 20:23:48 2022] *** May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: nodename: dv-cinder-835881-13-smb May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: machine: x86_64 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: clock source: unix May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: pcre jit disabled May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: detected number of CPU cores: 4 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: current working directory: / May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: detected binary path: /usr/bin/uwsgi-core May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: your processes number limit is 47680 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: your memory page size is 4096 bytes May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: detected max file descriptor number: 2048 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: lock engine: pthread robust mutexes May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: thunder lock: enabled May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 20:23:48.066536 dv-cinder-835881-13-smb devstack@keystone.service[270812]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 20:23:48.110125 dv-cinder-835881-13-smb devstack@keystone.service[270812]: Python main interpreter initialized at 0x55bf98c089c0 May 19 20:23:48.110125 dv-cinder-835881-13-smb devstack@keystone.service[270812]: python threads support enabled May 19 20:23:48.110125 dv-cinder-835881-13-smb devstack@keystone.service[270812]: your server socket listen backlog is limited to 100 connections May 19 20:23:48.110125 dv-cinder-835881-13-smb devstack@keystone.service[270812]: your mercy for graceful operations on workers is 90 seconds May 19 20:23:48.110568 dv-cinder-835881-13-smb devstack@keystone.service[270812]: mapped 403077 bytes (393 KB) for 2 cores May 19 20:23:48.110568 dv-cinder-835881-13-smb devstack@keystone.service[270812]: *** Operational MODE: preforking *** May 19 20:23:48.110851 dv-cinder-835881-13-smb devstack@keystone.service[270812]: *** uWSGI is running in multiple interpreter mode *** May 19 20:23:48.110851 dv-cinder-835881-13-smb devstack@keystone.service[270812]: spawned uWSGI master process (pid: 270812) May 19 20:23:48.111106 dv-cinder-835881-13-smb systemd[1]: Started Devstack devstack@keystone.service. May 19 20:23:48.111677 dv-cinder-835881-13-smb devstack@keystone.service[270812]: spawned uWSGI worker 1 (pid: 270826, cores: 1) May 19 20:23:48.112016 dv-cinder-835881-13-smb devstack@keystone.service[270812]: spawned uWSGI worker 2 (pid: 270827, cores: 1) May 19 20:23:48.112168 dv-cinder-835881-13-smb devstack@keystone.service[270812]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 20:23:53.676372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:53.676372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: from cryptography.utils import int_from_bytes May 19 20:23:53.677332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:53.677332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: from cryptography.utils import int_from_bytes May 19 20:23:53.727187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:23:53.727440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:23:53.727542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] command line args: [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:23:53.727817 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:23:53.727979 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ================================================================================ {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:23:53.728230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] admin_token = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.728475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] config_dir = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.728651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.728794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] config_source = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.729005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] debug = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.729162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.729471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:53.729471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: from cryptography.utils import int_from_bytes May 19 20:23:53.730078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] insecure_debug = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 20:23:53.730235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: from cryptography.utils import int_from_bytes May 19 20:23:53.730361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_config_append = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.730992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_dir = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.731112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_file = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.731369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.731589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.731863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.732077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.732237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.732432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.732669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.732911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.733147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.733372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.733582 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.733810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.734065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.734307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] notification_format = cadf {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.734582 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.735092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.735272 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] publish_errors = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.735500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.735726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.735901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.736146 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.736363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.736594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] standard_threads = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.736822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] strict_password_check = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] use_eventlog = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] use_journal = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] use_json = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737758 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] use_stderr = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.737931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] use_syslog = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.738157 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] watch_log_file = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.738410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.738645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.738929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.739166 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.739411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.739645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.739887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.740118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.740361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.740607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.740864 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.741096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.741339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.741576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.741819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.742063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.742296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.742548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.742821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.743065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.743299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.743548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.743807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.744058 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.744308 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.744529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.744756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.744982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.745213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.745482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.745727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.745952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.746179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.746434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.746712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.746935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.747183 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.747414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.747648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.747881 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.748106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.748334 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.748559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.748785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.749017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.749263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.749491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.749723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.749950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.750181 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.750415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.750661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.750909 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.751141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.751374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.751612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.751847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.752079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.752304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.752550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.752781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.753013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.753237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.753493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.753724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.753951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.754184 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.754418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.754705 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.754933 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.755177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.755419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.755648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.755879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.756108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.756363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.enabled = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.756598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.756833 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.757073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.757307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.757540 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.757772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.758002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.758233 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.758492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.758757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.758996 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.759229 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.759467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.759699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.759931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.760164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.760390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.760617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.760842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.761124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.761351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.761593 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.761825 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.762070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.762302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.762671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.762956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.763195 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.763427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.external = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.763657 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.mapped = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.763952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.764181 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.764413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.password = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.764643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] auth.token = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.764881 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.765114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] catalog.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.765358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.765588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.765833 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.766076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.766376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.766657 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.766930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.767175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.767423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.767656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.767899 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.768130 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.768392 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.768642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.768877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.769126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.769408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.769653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.769912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.770153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.770406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.770637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.770894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.771136 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.771381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.771612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.771855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.772089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.772338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.772570 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.772819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.773050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.773292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.773523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.773766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.774007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.774238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.774467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.774734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.774964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.775199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.775444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.775692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.775921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.776149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.776376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.776663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.777019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.777277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.777532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.777775 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.778041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.778276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.778509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.778770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.779002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.779228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.779461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.779697 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.779931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.780174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.780401 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.780645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.780887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.781116 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.781356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.781616 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.781842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.782075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.782299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.password = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.782533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.782794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.783033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.783266 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.783498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.783742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.783986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.784213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.784438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.784539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 20:23:53.784647 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 20:23:53.784744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.784842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] command line args: [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 20:23:53.784941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.785097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 20:23:53.785201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.785289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ================================================================================ {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 20:23:53.785385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.785536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] admin_token = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.785641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.785774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.785875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] config_dir = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.785969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.786065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.786159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] config_source = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.786245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.786336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] debug = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.786464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.786572 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.786717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.786821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.786936 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] insecure_debug = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.787036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.787191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.787309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.787425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.787536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.787650 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.787810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.787810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_config_append = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.787991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.788090 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.788177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.788273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_dir = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.788358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.788450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_file = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.788548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.788635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.788742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.788851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.788987 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.789088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.789228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.789330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.789426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.789518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.789611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.789707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.789800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.789894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.790038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.790139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.790275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.790381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.790509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.790610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.790769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.790884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.790989 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.791086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.791239 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.791340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.791487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] notification_format = cadf {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.791591 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.791720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.791823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.791970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] policy.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.792212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.792336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.792480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.792589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] publish_errors = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.792712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.792816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.792943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] receipt.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.793039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.793139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.793237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.793359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.793461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.793597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.793698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.793833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] standard_threads = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.793933 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.794133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] strict_password_check = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.794230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.794335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.794435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.794533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] use_eventlog = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.794625 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.794746 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] use_journal = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.794837 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.794939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] use_json = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.795040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] use_stderr = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.795133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] use_syslog = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.795336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795430 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] watch_log_file = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 20:23:53.795516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] revoke.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.795953 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796220 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796343 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] role.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796572 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] role.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796675 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] role.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.796914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] role.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.797875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798010 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798318 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798580 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798736 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.798982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799091 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799460 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.799957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800840 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.800946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801085 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.801918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.802919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803249 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.803954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804294 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.804998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805120 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805350 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805580 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805673 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.provider = fernet {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.805904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806783 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.806878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] trust.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.807942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808281 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808741 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.808979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809225 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.connection = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809600 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.809938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810308 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.810900 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811490 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811595 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811818 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.811967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.812906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813009 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.enabled = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.813783 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:23:53.813877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.814054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.814295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.814531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.814800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.815045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.815280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.815542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.815783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.816025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.816274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.816518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.816757 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.817006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.817243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.817478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.817712 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.817946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.818184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.818418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.818661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.818924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.819176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.819416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.819780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.820047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.820293 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.820529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.external = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.820764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.mapped = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.821065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.821302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.821538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.password = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.821773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] auth.token = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.822014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.822253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] catalog.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.822503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.822760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.823015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.823265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.823501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.823825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.824076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.824328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.824579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.824822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.825066 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.825302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.825571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.825827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.826065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.826321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.826607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.826882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.827151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.827398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.827655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.827893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.828132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.828380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.828631 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.828863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.829113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.829352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.829607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.829847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.830104 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.830343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.830592 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.830853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.831106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.831354 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.831593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.831830 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.832080 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.832312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.832552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.832804 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.833057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.833291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.833523 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.833755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.834001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.834247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.834500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.834786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.835037 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.835309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.835549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.835800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.836049 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.836283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.836516 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.836755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.837010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.837242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.837493 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.837727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.837978 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.838229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.838465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.838732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.838984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.839245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.839485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.839718 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.password = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.839957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.840196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.840443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.840680 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.840917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.841167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.841418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.841651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.841882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.842131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.842379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.842615 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.842876 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.843113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.843346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.843587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.843848 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.844087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.844311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.844417 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.844542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.844639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.844761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.844867 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.845334 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.845567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.845802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.846036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.846272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.846503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.846774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.847024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.847272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.847520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.847768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.847999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.848246 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.848495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.848732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.848968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.849203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.849452 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.849700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.849938 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.850192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] policy.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.850423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.850669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.850928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.851163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] receipt.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.851399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.851646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.851889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.852122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.852358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.852598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.852849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.853098 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.853335 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.853584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.853798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.853902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.854078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] revoke.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.854324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.854561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.854916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] role.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.855159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] role.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.855407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] role.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.855639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] role.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.855891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.856141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.856389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.856639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.856887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.857134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.857381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.857629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.857862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.858110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.858359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.858607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.858890 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.859302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.859539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.859790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.860042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.860291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.860541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.860776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.861030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.861294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.861536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.861770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.862006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.862226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.862478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.862759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.863020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.863262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.863505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.863739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.863975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.864214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.864464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.provider = fernet {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.864701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.864961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.865212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.865451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.865695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.865938 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.866187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] trust.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.866423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.866663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.866923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.867172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.867425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.867660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.867903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.868197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.868460 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.connection = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.868707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.868954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.869192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.869432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.869668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.869904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.870140 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.870401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.870648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.870911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.871154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.871390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.871639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.871873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.872118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.872350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.872590 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.872824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 20:23:53.872997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=270827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 20:23:53.881680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.881903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.898459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.898719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.898956 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.909319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.928097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.928250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.933663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.965811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.984331 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:53.984515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.003938 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.004151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.047872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.048962 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.049097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.049349 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.049534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.049785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.071712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.071886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072570 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072813 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.072965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.073124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.073215 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.073454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.084197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.084743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.097524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.097710 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.097967 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.098196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.098448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.098644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.098796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.098886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.099014 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.099254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.099475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.099641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.099886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.100100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=270826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 20:23:54.116212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.116406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:54.116535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.116628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:54.116716 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.116954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117107 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:54.117191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 20:23:54.117295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.117898 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.118003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.118079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.129177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.129455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.129715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.129993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.130833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.131115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.131384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.131665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.138039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.139789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.141307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.141581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.141851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.142239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.142521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.142801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143205 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.143287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143396 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143733 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143833 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.143964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.144075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.144273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.144534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.144809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.145089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.145347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.145621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.145887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.170202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.171825 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.172096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.172384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.173988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.174268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.177304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.177576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.177852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.179607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.179829 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.180112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.185422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.185698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.188035 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.188239 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.190261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.190511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.190847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.191093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.191375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.191644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.191909 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.192143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.195099 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.195400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.195694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.196151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.196874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.197330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.197729 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.198016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.215622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.215867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.220759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.222462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.222766 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.224404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.224691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.227288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.229592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.230959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.231260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.233170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.236229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.236955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.237250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.237479 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.237796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.238070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.238347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.239904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.243650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.243948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.244232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.244511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.244785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.245048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.257241 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.257613 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.257882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.258159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.264100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.264482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.264753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.265025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.266030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.267774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.268048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.271094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.271376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.271661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.271936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.272223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.272966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.274711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.274991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.278125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.278425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.278731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.279014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.279304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.285631 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.285909 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.286185 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.286462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.286773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.287036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.287315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.292745 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.293030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.293321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.293607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.293890 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.294150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.294424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.305208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.308869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.312682 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.312845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.314381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.315988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.316149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.316368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.316646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.319322 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.320941 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.322610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.323260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.323260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.324038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.325654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.328853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.329119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.329419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.329664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.330603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.332260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.335531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.335833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.336141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.336388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.338822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.339203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.339522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.346017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.346306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.346589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.347724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=270826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.348001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.348271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.348549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.348812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.349084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.349348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.349610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.349871 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.350129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.350404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.350658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.350948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.351213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=270826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.354655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=270827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 20:23:54.354993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.355277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.355553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.355844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.356115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.356397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.356664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.356935 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.357214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.357494 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.357763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.358019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.358288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=270827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 20:23:54.389728 dv-cinder-835881-13-smb devstack@keystone.service[270826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf98c089c0 pid: 270826 (default app) May 19 20:23:54.393122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d386-bb0e-49c5-80fe-a6db326f860f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:23:54.393421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d386-bb0e-49c5-80fe-a6db326f860f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:23:54.393703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d386-bb0e-49c5-80fe-a6db326f860f None None] PATH_INFO: `/v3` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:23:54.396940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf98c089c0 pid: 270827 (default app) May 19 20:23:54.397899 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Thu May 19 20:23:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:02.441384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.442297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.442297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.449537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:02 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:02.458115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:02.458584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:02.458738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:02.527822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: INFO dbcounter [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] Registered counter for database keystone May 19 20:24:02.552990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG oslo_db.sqlalchemy.engines [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=270826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:24:02.561779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writer thread running {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:24:02.742050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG passlib.handlers.bcrypt [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=270826) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:24:02.742461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG passlib.handlers.bcrypt [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=270826) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:24:02.798485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:02.800152 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:02.929413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 20:24:02.953271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.035702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: INFO dbcounter [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] Registered counter for database keystone May 19 20:24:03.057960 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG oslo_db.sqlalchemy.engines [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=270827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 20:24:03.069245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writer thread running {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 20:24:03.205614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505de370-4746-4b8f-9b03-d0cc545f0cb2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.211318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302016200c584d9f8ebe7afab4995fd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.212000 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.212287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.212567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.222079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.273464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:24:03.273782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93483d2-9da7-4f8b-b8e6-4c98ced9d87c admin admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.284573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 20:24:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:24:03.294814 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:03.314978 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0751-e19c-4ca0-9c57-c8bb0902e4e0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:03.320692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302016200c584d9f8ebe7afab4995fd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:03.321845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:03.322135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:03.322417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] PATH_INFO: `/v3/projects/302016200c584d9f8ebe7afab4995fd0` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:03.324065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] RBAC: Authorizing `identity:get_project(project_id=302016200c584d9f8ebe7afab4995fd0)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:03.487767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 20:24:03.488480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7e061-59b8-410a-9e0a-9e138ddc7b40 admin admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:03.493535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Thu May 19 20:24:03 2022] GET /identity/v3/projects/302016200c584d9f8ebe7afab4995fd0 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:05.685150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537f311-9b9a-48c4-acf8-ce27be3f4edb None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.685744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537f311-9b9a-48c4-acf8-ce27be3f4edb None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.685744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537f311-9b9a-48c4-acf8-ce27be3f4edb None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.690041 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:05.697002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.697761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.697954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.720556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:05.722095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:05.732206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 20:24:05.754582 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537f311-9b9a-48c4-acf8-ce27be3f4edb None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.769916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537f311-9b9a-48c4-acf8-ce27be3f4edb None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.775788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302016200c584d9f8ebe7afab4995fd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.776461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.776772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.777024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.785831 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.787654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec79e6-decb-40c5-8a25-bb9b02921dc7 admin admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.796775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 20:24:05.802548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:05.812009 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f20b4-ebf1-45c7-b3ea-ea922df5242f None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:05.818678 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '302016200c584d9f8ebe7afab4995fd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:05.819586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:05.819872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:05.820153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:05.821805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:05.823814 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f4e59-f5c8-413d-80bf-f5f3371edf0f admin admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:05.825396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Thu May 19 20:24:05 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.100428 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a69-8196-4629-95cb-10da31a45ea1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.101032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a69-8196-4629-95cb-10da31a45ea1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.101032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9a69-8196-4629-95cb-10da31a45ea1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.102368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:08.107989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.108454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.108566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.125981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:08.127171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:08.137581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f662e3-91ab-426a-98e9-da46bd7c91a1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.137881 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f662e3-91ab-426a-98e9-da46bd7c91a1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.138167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f662e3-91ab-426a-98e9-da46bd7c91a1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.139621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:08.145062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.145355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.145693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.186147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG passlib.handlers.bcrypt [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=270827) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 20:24:08.186601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG passlib.handlers.bcrypt [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=270827) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 20:24:08.208076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:08.231721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.233584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:08.235218 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:08.263993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.348350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:08.349180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073556d-6d39-433a-bf01-4a068757e9dc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.370651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.385827 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.386633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.386947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.387224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.399506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:08.410936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:08.412171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:08.413223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:08.418113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.476796 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb72eb-8ff6-47d9-a662-c6af6d2028f3 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.479197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.502782 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.515806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.516737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.517027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.517310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.521794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244aadf-aa35-4d0c-aff1-4f976441ced8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.556790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.557488 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.557776 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.558056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.558860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:08.559175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.560619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.572629 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:08.578465 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.587083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.588668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.681524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3fcc0-509a-48a3-89b0-3aacaf3f8518 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.691727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:08.697401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.700185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.717136 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004703-02e6-473d-8469-365e350541b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.718545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004703-02e6-473d-8469-365e350541b7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.718872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004703-02e6-473d-8469-365e350541b7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.719218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004703-02e6-473d-8469-365e350541b7 None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.722807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004703-02e6-473d-8469-365e350541b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.724314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004703-02e6-473d-8469-365e350541b7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.726000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:08.731635 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004703-02e6-473d-8469-365e350541b7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.746208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.803271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6b2b2-3c4f-465d-be13-64222cacd518 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.830522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004703-02e6-473d-8469-365e350541b7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.837923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.838755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.839043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.839320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.858599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.860156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.865830 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:08.867047 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:08.867345 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:08.867626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:08.869224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:08.870713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:08.872380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:08.878223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:08.881333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:08.882457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:08.883776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:08.883776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:08.883776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:08.883776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:08.883776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:08.888541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:08.944731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.961284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:08.981099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a009d7-383f-49f1-9965-6089f75e55d4 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:08.993962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967d20-bcab-4aea-9f4a-d966fb74adaa None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:09.015527 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.016185 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.016471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.016739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.017593 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.domain.id=default, user.id=f100ebbb9b184141b0c51253d104fc9a) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:09.017936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.019476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be638a4-2f64-438e-98aa-a18fc7c2aca3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.026272 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/role_assignments?user.id=f100ebbb9b184141b0c51253d104fc9a&scope.domain.id=default&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:09.028638 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:09.029343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:09.029933 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:09.029933 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:09.030616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:09.030959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:09.032507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347b7c6-6ee1-428e-aeee-56537c0bd343 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:09.054822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:11.486611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3ccc2-dff7-41eb-8c03-31aa8f7b20f1 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.487298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3ccc2-dff7-41eb-8c03-31aa8f7b20f1 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.487298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3ccc2-dff7-41eb-8c03-31aa8f7b20f1 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.488561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:11.494356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba36-5d51-4f51-be08-1e8afa6a8333 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.495031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba36-5d51-4f51-be08-1e8afa6a8333 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.495031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba36-5d51-4f51-be08-1e8afa6a8333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.659100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-f0b5ba36-5d51-4f51-be08-1e8afa6a8333 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:11.660323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-f0b5ba36-5d51-4f51-be08-1e8afa6a8333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.751771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:11.758843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac358-6918-42d7-b3df-25b1c2b70bf1 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.759453 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac358-6918-42d7-b3df-25b1c2b70bf1 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.759964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ac358-6918-42d7-b3df-25b1c2b70bf1 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.761614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:11.767118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3009d6-f525-4576-8558-67b2faa6ca53 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.767412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3009d6-f525-4576-8558-67b2faa6ca53 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.767695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3009d6-f525-4576-8558-67b2faa6ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.785694 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541c173-8106-45ef-8784-d5f65f9a8c0b None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.786374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541c173-8106-45ef-8784-d5f65f9a8c0b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.786901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541c173-8106-45ef-8784-d5f65f9a8c0b None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.788494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 14/25] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:11.790796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541c173-8106-45ef-8784-d5f65f9a8c0b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:11.794122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-ff3009d6-f525-4576-8558-67b2faa6ca53 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:11.795333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-ff3009d6-f525-4576-8558-67b2faa6ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.850769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:11.910155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 12/26] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:11.911461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:11.911755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:11.912038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:11.946525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:11.947757 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:11.970632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541c173-8106-45ef-8784-d5f65f9a8c0b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.043498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.048984 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.049432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.049872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.062174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.064099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.066906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:24:12.096938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:12.098172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:12.099415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:24:12.099415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:24:12.099415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:24:12.099415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:12.114997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 13/27] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:12.116386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.117772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 15/28] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:12.123904 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.316601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b1dda-ef9e-4bff-9b86-b5607cb64850 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.321608 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab600c-b525-4ea0-a7f1-a458b251d1cb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.335802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.361505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.362517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.362994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.363448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.364340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:12.364907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.366493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.366643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.367416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.367699 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.367974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.379862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:12.385845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 16/29] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.386956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e2ac63a1-b7b4-45ce-a463-f44fb05cb56f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:12.389149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:12.390149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:12.391136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 14/30] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:12.396463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c001f8-cca5-451a-837d-59c3ad760854 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.396752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c001f8-cca5-451a-837d-59c3ad760854 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.397034 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c001f8-cca5-451a-837d-59c3ad760854 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.398333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 15/31] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:12.403077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c001f8-cca5-451a-837d-59c3ad760854 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.471095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.513390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d322-52a9-4ae8-b27a-1909f618415f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.520417 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c001f8-cca5-451a-837d-59c3ad760854 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.551422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.552518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.553012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.553544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.554537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.556179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.556455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.556851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.557134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.557468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.558427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.559904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b28b1-6fa8-477b-a65a-e17cb0fa3e0f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.685633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 17/32] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:24:12 2022] POST /identity/v3/roles => generated 225 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:12.687114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.704077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 16/33] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:24:12 2022] POST /identity/v3/projects => generated 301 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:12.706159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.706291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.706490 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.740416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:12.747601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:12.771799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.810134 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582ee94-33aa-49d2-9cf8-5807d35552d5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:12.833969 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:12.852170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:12.853561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:12.854298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:12.855105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:12.856169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:12.856746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:12.858655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:12.870579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 18/34] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:12.877605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:12.895231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 17/35] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:12.967936 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.070178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454ab3-f3e9-4b11-9c2b-00e9976d0b65 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.100849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59a8eb-406d-4b07-b80f-30c58da5cf05 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.117517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.118418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.118712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.119024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.121190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.122963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.125515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 19/36] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:12 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:13.131210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.148921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.149972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.150531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.151150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.152223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.154002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.177213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:24:12 2022] POST /identity/v3/roles => generated 219 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:13.196646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.270090 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c458e2-4054-4d0c-b909-53d84d647872 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.313257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.314582 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.315125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.315630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.317241 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.319011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc3a1a-0f36-4670-9ac7-97700c6345ee None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.321418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:13.335852 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.351192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.416772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b843d2-2cc8-4b03-9dac-dbb6330ed28c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.417126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b843d2-2cc8-4b03-9dac-dbb6330ed28c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.417319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b843d2-2cc8-4b03-9dac-dbb6330ed28c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.418972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 21/39] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:13.424698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6e7-9982-4ae8-abf4-c291cce64111 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.424991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6e7-9982-4ae8-abf4-c291cce64111 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.425270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6e7-9982-4ae8-abf4-c291cce64111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.445612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-800cb6e7-9982-4ae8-abf4-c291cce64111 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:13.447209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-800cb6e7-9982-4ae8-abf4-c291cce64111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:13.469502 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d4f84-6212-44c5-8c71-f8af7880ab1e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.509096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.509983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.510287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.510786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] PATH_INFO: `/v3/domains/default/users/f100ebbb9b184141b0c51253d104fc9a/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.513061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f100ebbb9b184141b0c51253d104fc9a, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.514555 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.521194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 22/40] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:13.522376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc56562-135a-4d32-9689-6ff36f3d5435 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.522677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc56562-135a-4d32-9689-6ff36f3d5435 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.522995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc56562-135a-4d32-9689-6ff36f3d5435 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.525286 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 23/41] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:13.529963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.530236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.530523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.542931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 19/42] 10.222.0.77 () {58 vars in 1361 bytes} [Thu May 19 20:24:13 2022] PUT /identity/v3/domains/default/users/f100ebbb9b184141b0c51253d104fc9a/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:13.545181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.549393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:13.550627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:13.608233 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.621790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.645755 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 24/43] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:13.660247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab3f9-180d-4d60-9b79-dd93d9af47cd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.669182 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.702715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.703434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.703720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.703999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.704823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.706980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.727054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 20/44] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:24:13 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:13.787659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c1d0-b81e-4b2e-ac5b-8f5a24858d80 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.825443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.826465 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.826888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.827297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.828707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.830332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a051c7-76ad-4797-a57f-bfb5fd6bda8f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:13.832223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 25/45] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:13.837975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:13.952076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2edd1-ed76-4c6d-a3f6-5450a76ed521 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:13.979998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:13.990430 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:13.991142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:13.991435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:13.991717 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:13.992445 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:13.993909 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59768c-3758-4460-a104-a93ae6fe9bc6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:14.020586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 21/46] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:24:13 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:15.797778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42485f4-ed63-4489-8032-593f2ef85a20 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.798332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42485f4-ed63-4489-8032-593f2ef85a20 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.798332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42485f4-ed63-4489-8032-593f2ef85a20 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.799872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 26/47] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:15.805458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:15.805927 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:15.806075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:15.823560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:15.824757 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:15.898573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 22/48] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:15.921677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42485f4-ed63-4489-8032-593f2ef85a20 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:15.969105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.033751 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42485f4-ed63-4489-8032-593f2ef85a20 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.071531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.072257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.072545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.072849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.085550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-96cee3ff-244e-4b85-b0e7-6a4e06ed5335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:16.093390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:16.094448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:16.095734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 27/49] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:16.102838 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.205565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7393a6-e95a-4f83-8e80-96cdcbe88571 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.216794 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.243036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b8a5-669f-4ce2-bd09-7385b41b341a None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.243272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.243400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b8a5-669f-4ce2-bd09-7385b41b341a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.243606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152b8a5-669f-4ce2-bd09-7385b41b341a None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.243821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.244106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.244384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.245173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 28/50] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:16.245300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:16.245544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.247068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.250263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.250555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.250881 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.259306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 23/51] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:16.264716 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.268463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:16.269663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:16.337165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 29/52] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:16.360383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.366822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e16dc1-74d8-44fe-b746-fbb4528baedb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.391936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.401004 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.401887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.402167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.402440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.403678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.405251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.406930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 24/53] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:16.412235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.453449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.463045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380c00-84e7-424d-bf0c-f44658a2303e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.498704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.499517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.499803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.500078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.501313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.502877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.504516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 30/54] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:16.510156 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.517351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91959bdf-7026-49e3-93ad-6d4e4a0324ca None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.551162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.552051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.552339 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.552619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.553822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.555313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.556948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 25/55] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:16.562770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:16.606863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.611405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b41308-c02f-4aa0-ac80-b1ad6971207c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.648078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.648748 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.649028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.649306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.650026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.651648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a69dd9-a724-4e3c-a009-7f526fcebea3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.665618 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d6d-2230-44fd-9f7c-d40f37ba3fe8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:16.676806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:16.680439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 31/56] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 20:24:16 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:16.703095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:16.703786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:16.704071 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:16.704350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:16.705212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.domain.id=default, user.id=f100ebbb9b184141b0c51253d104fc9a) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:16.705524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:16.707033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05968726-3e97-4b43-bb27-426c0364809f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:16.716440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 26/57] 10.222.0.77 () {56 vars in 1322 bytes} [Thu May 19 20:24:16 2022] GET /identity/v3/role_assignments?user.id=f100ebbb9b184141b0c51253d104fc9a&scope.domain.id=default&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:18.931320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1adf-1a33-4858-84f3-4ac3a71e2748 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:18.931868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1adf-1a33-4858-84f3-4ac3a71e2748 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:18.931868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1adf-1a33-4858-84f3-4ac3a71e2748 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:18.933311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 32/58] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:18.939838 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:18.940229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:18.940465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:18.966993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:18.968210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:19.048237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 27/59] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:19.076285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e1adf-1a33-4858-84f3-4ac3a71e2748 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.191256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e1adf-1a33-4858-84f3-4ac3a71e2748 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.227403 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.228199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.228486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.228768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.230156 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.231707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80151a8d-14c7-40f8-9d5b-d7572bc02e63 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.233326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 33/60] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:19.239778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:19.357905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5075290-a672-43cc-9f01-32187668eb37 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:19.359513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:19.395200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:19.395879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:19.396165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:19.396456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:19.397177 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:19.398637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a719-090f-46b4-b881-33845e9b952c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:19.426288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 28/61] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:19 2022] POST /identity/v3/users => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:22.823104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0302d-94b8-46ec-97c0-5d75e1cc9821 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.824204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0302d-94b8-46ec-97c0-5d75e1cc9821 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.824716 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0302d-94b8-46ec-97c0-5d75e1cc9821 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.826345 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 34/62] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:22.832116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.833017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.833541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.863175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:22.864842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:22.934819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c2f2-902e-4985-8936-7c7f8447af12 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.935543 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c2f2-902e-4985-8936-7c7f8447af12 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.936060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c2f2-902e-4985-8936-7c7f8447af12 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.937664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 35/63] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:22.943169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:22.943698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:22.944186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:22.968447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:22.970894 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 29/64] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:22.972523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:22.995120 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.015280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.126187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.144385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 36/65] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:23.148574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d3d2-3bed-433c-80bf-0cea48218491 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.181386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.211990 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.212459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.212749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.213028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.226458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-070ad94f-9cde-4ab5-bfc6-be06530642eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:23.234847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:23.235959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:23.237079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 30/66] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:23.238042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a24b77-9d11-415f-8b16-5be1fc242872 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.238042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a24b77-9d11-415f-8b16-5be1fc242872 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.238042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a24b77-9d11-415f-8b16-5be1fc242872 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.239211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 31/67] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:23.244002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a24b77-9d11-415f-8b16-5be1fc242872 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.301422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95d831-10fd-43ec-84c4-a4c9d16dfe03 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.338862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.339887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.340357 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.340790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.352589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:23.356693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a24b77-9d11-415f-8b16-5be1fc242872 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-aba401fc-060e-46b5-b58c-bf208475cd6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:23.360655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:23.361671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:23.362598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 37/68] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:23.363427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7722a-b50c-4316-993f-287fb7875cd8 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.363508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7722a-b50c-4316-993f-287fb7875cd8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.364133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7722a-b50c-4316-993f-287fb7875cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.386968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-48d7722a-b50c-4316-993f-287fb7875cd8 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:23.388927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-48d7722a-b50c-4316-993f-287fb7875cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:23.391852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.392151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.392856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.393156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.393433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.394155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:23.394463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.395906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aa36-1182-4717-a35d-c99cd168f428 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.405277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 32/69] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.406587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865381-f41c-4a3c-96fb-b4190a5a61d6 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.406881 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865381-f41c-4a3c-96fb-b4190a5a61d6 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.407158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27865381-f41c-4a3c-96fb-b4190a5a61d6 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.408384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 33/70] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:23.409075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865381-f41c-4a3c-96fb-b4190a5a61d6 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.421122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.465966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 38/71] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:23.468132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3e174-2735-4d20-bb3c-b544556e0ab0 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.468444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3e174-2735-4d20-bb3c-b544556e0ab0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.468754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3e174-2735-4d20-bb3c-b544556e0ab0 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.470575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 39/72] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:23.471172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3e174-2735-4d20-bb3c-b544556e0ab0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.517609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27865381-f41c-4a3c-96fb-b4190a5a61d6 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.557056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.557811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.558097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.558405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.559210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:23.559525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.560977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf5994-ac1f-472c-947c-8630df44020f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.570156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 34/73] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.575440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.575440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.575440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.578600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3e174-2735-4d20-bb3c-b544556e0ab0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.591309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:23.592525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:23.613514 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.614409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.614710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.615018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.625746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.629644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.631394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a4c0b-85ac-4d08-972b-0f2de0ec795e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.633112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 40/74] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.634315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.634606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.634913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.651171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:23.652321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:23.669047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 35/75] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:23.669981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.672262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.726021 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 41/76] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:23.727132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.773375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8d89-a9f6-480d-8679-d2a7e1c90480 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.807972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.808804 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.809090 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.809376 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.819884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:23.828195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:23.829265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:23.835914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:23.836645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faede75-17fb-412d-af2b-0f258263f745 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.837008 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 36/77] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:23.837008 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.855476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.863761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.864688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.864977 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.865261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.866469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:23.868017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:23.869710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 42/78] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:23.871086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:23.897250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:23.938083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c529e86-fce7-41d1-a0c6-1bcda3831af8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:23.972702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:23.973367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:23.973655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:23.973937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:23.974299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60906012-68d7-41b8-b916-0e26c0e75a53 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.007839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.008637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.008919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.009195 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.010530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.012117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.013934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 43/79] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.014522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.046466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.047987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.074853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.110244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.114030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bea9c-eef7-466a-b88a-a872e1c1d2ae None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.148718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.149528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.149812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.150090 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.150415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 37/80] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:24.151349 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.165460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:24.173180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:24.174217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 44/81] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:24.175186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.256191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ec421-cdaf-495b-bd3c-50f85026ac17 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.279616 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b93a41-a55b-4ce6-8ab5-5468d98cf9ed None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.290654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.291446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.291734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.292012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.292767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:24.293074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.294453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.302896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.303041 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 38/82] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.303557 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.317776 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.318430 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.318742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.319030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.329065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.390140 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.391707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.403010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5bdb1-8a14-4e43-9f84-94d714249cd8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.436517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.437202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.437487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.437764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.438477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.439981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.461475 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 39/83] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:24 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:24.461475 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.514308 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 45/84] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:24.515198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.544022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.557762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.584809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c6324-aa39-48c8-93c1-f9ead835fd3c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.625913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.627170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.627717 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.628173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.629832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.631635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.638603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d758b-e01c-4e54-b15c-488a92b7b6e3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.639507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 40/85] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.640093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.676059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.677374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.677666 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.677947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.678766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:24.679093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.680569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.689470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 46/86] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.694222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.762660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdfecb-d6d5-4dfb-b846-9fa9acda838a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.798168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.804948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.805857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.806144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.806422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.807736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.809212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.811127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 41/87] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.811713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.820336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1e0e8-9195-44ab-8421-b8db55a0685e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.833857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:24.863259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.864193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.864742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.864742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.865956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:24.867521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:24.869203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 47/88] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:24.870066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:24.946414 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9899-6852-4a6c-8acf-94befe053414 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.988425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6cef-7fe2-4d26-81cf-fe8aec8c6603 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:24.995596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:24.996820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:24.997111 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:24.997394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:24.998746 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:24.999075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.001267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.009067 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 42/89] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:25.010033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.071746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.072627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.072915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.073193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.074552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.076063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.078087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 48/90] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:24 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:25.088015 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.138356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.157842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.159051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f2c32-ca73-41e8-ad3e-6be209202e22 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.219042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.220653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.221300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.221817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.302597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0962-c299-45eb-8b45-32af7c86851f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.304468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.305983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.361131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.362241 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.362886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.363575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.364665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=f100ebbb9b184141b0c51253d104fc9a) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:25.365208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.367265 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.382589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 49/91] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/role_assignments?user.id=f100ebbb9b184141b0c51253d104fc9a&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:25.383483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.389664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.420032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 43/92] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:25.426657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.543423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b297-34c4-4902-b56b-6a9d9430b21e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.575187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.583388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.584462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.584949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.585387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.586864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.588903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.591297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 44/93] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:25.598461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:25.614187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03387c37-7b8d-4215-bd3e-f6881f02dc07 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.670128 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.670891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.671382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.671668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.735529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.785894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.787466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.850441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ad645-b328-40a0-ab4e-4cd027327a16 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:25.935855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:25.936636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:25.937373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:25.937599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:25.937877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:25.938759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:25.939076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:25.940539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:25.959288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 50/94] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:25.964187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 45/95] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:25.970724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.132883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3564be-fab7-4dbd-9a94-05b43371caa0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.153696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:26.185666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.186970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.187474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.187948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] PATH_INFO: `/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.189412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] RBAC: Authorizing `identity:get_project(project_id=4ed2838c2d954ae69bfa9b34cbc1344a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:26.191125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103de00-77ce-497e-b6e6-faf7e1bc2c1d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:26.194533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 46/96] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:25 2022] GET /identity/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:26.199795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:26.338857 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679aab2-6dcd-46d4-9afd-dbb4e385ac62 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:26.382296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:26.383074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:26.383309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:26.383591 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:26.384459 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=4ed2838c2d954ae69bfa9b34cbc1344a, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:26.384769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:26.386321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405446-9153-4fbf-9de3-e9882d354e69 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:26.394924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 51/97] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:26 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=4ed2838c2d954ae69bfa9b34cbc1344a&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:27.782123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77905d-f287-43b3-81a5-8bd44517ebeb None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.782752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77905d-f287-43b3-81a5-8bd44517ebeb None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.782752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77905d-f287-43b3-81a5-8bd44517ebeb None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.784445 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 47/98] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:27.789896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5932a8-9e9f-4571-842f-39d8dbfba452 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.790371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5932a8-9e9f-4571-842f-39d8dbfba452 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.790472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5932a8-9e9f-4571-842f-39d8dbfba452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.808612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-dc5932a8-9e9f-4571-842f-39d8dbfba452 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.809853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-dc5932a8-9e9f-4571-842f-39d8dbfba452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:27.847115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b0e7-8ad5-4a7c-885d-e0174eba9d73 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.847492 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b0e7-8ad5-4a7c-885d-e0174eba9d73 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.847699 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b0e7-8ad5-4a7c-885d-e0174eba9d73 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.849105 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 48/99] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:27.868361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.868676 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.868934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.885293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:27.898665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.899921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:27.925253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 52/100] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:27.926454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4348-323b-41e1-8134-6c37d089d479 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.926885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4348-323b-41e1-8134-6c37d089d479 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.927175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca4348-323b-41e1-8134-6c37d089d479 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.928794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 53/101] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:27.935894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:27.936180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:27.936470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:27.959085 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:27.960417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:28.024586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 49/102] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:28.025268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.061853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 54/103] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:28.063337 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.150981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e217e-52fe-4f51-8790-8c99f712c50c None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.159121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.193115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.194376 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.194868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.195415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.202477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.204290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.206383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 50/104] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.207378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.215361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ece34-6d80-4b9a-ae23-1322aef1ac8e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.231127 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.279438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.280474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.280870 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.281250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.304164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:28.320585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:28.321805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 55/105] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:28.322982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.349657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db2f95-59fd-43fb-b271-d5613dfb60ae None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.388131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.389387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.389859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.390375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.402584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:28.411086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:28.412173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:28.413106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:28.415856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 51/106] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:28.417063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.461641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.530510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a84e4-5cbb-463b-9436-31ce41051759 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.560882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bca6a-7634-4c8e-b379-d21b35e0ac6a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.569841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.571053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.571577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.572061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.573229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:28.573756 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.575438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.586195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 52/107] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.587403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.648474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.649174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.649461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.649742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.650565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.652189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.709271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 56/108] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:24:28 2022] POST /identity/v3/projects => generated 302 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:28.710159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.761338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.765646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db170c96-dcc5-4f22-ac7d-2eda49260c69 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.778213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:28.839071 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.839689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.840015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.840271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.841078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:28.841390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.842820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf9e5-89af-4552-bf23-da0cfca918cc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.862268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 53/109] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.863851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9aee4-86c7-4be1-a8ce-df258b790073 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.864150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9aee4-86c7-4be1-a8ce-df258b790073 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.864438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9aee4-86c7-4be1-a8ce-df258b790073 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.865859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 54/110] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:28.870902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9aee4-86c7-4be1-a8ce-df258b790073 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:28.901878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f22b1c-aacc-41ee-94bb-38cd936ae724 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:28.943859 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:28.945292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.945813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.946308 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.948093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:28.949911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580c72f-6e19-4e8e-96f7-b0a87f008854 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:28.951913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 57/111] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:28.953358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:28.953867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:28.954370 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:28.973305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:28.974919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:29.057306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9aee4-86c7-4be1-a8ce-df258b790073 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.069410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 58/112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:29.070369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.097589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.117574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.118470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.118792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.119119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] PATH_INFO: `/v3/users/be179fe326884c2f8da11aa9a8f4982c` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.140955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] RBAC: Authorizing `identity:get_user(user_id=be179fe326884c2f8da11aa9a8f4982c)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.143061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217163e-6401-499c-b90f-278d0c394c95 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.147992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 55/113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:28 2022] GET /identity/v3/users/be179fe326884c2f8da11aa9a8f4982c => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.147992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea497a5-5de3-45e6-9d1d-fb75290c0541 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.147992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea497a5-5de3-45e6-9d1d-fb75290c0541 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.147992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea497a5-5de3-45e6-9d1d-fb75290c0541 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.148519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 56/114] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:29.149082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea497a5-5de3-45e6-9d1d-fb75290c0541 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.183869 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.201442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cddf85-3338-4847-b94e-7bbd972fba2c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.252311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.253448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.253737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.254038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.256022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.258152 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.260449 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 59/115] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.261896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.275718 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea497a5-5de3-45e6-9d1d-fb75290c0541 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.313294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.314166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.314455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.314780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.337822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-131bd4d6-1c90-492b-a379-c51bf8deb57b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:29.348783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:29.349845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:29.350836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 57/116] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:29.356910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.357221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.357498 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.378279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:29.380150 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.380318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:29.396323 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc074-10ff-453a-aba8-5fb69e6f5a9d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.434311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.435300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.435762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.436298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.463626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 58/117] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:29.464575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.477826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.509164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.510925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.579193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388a029-6cdf-4b46-ae71-a64089cf38f3 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.598929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.612754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 60/118] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:29.613770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.621524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.622841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.623442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.623988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/ad3237a70cf647d2954966a44b02415b/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.626621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, user_id=ad3237a70cf647d2954966a44b02415b, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.628737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.647515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 59/119] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:29 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/ad3237a70cf647d2954966a44b02415b/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:29.649081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.727304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27c7b3-4fe3-44bb-8515-c3a1f29d2d2f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.736996 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.764740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.765535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.765828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.766108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.766930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:29.767241 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.768730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.778605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 61/120] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.779527 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.780696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f2aa8-3ebd-4fbc-8f93-db5e5095cbcc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.821620 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.823153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.823671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.824208 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.833768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:29.838136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:29.849250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:29.850916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:29.851877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:29.854805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 60/121] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:29.856495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.890405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb0726-5922-4659-9c95-c9b631e2ff88 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:29.959733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:29.960438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:29.960730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:29.961012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:29.962348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:29.963970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:29.965721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 62/122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:29.971764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:29.990724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa73a4c-afa3-4646-b47d-00676f5b350f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.028787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.030584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.031964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.032526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.033017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.034578 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.037065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.039449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 61/123] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.040644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.100701 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d68d7-f938-4b88-861c-d5797c75b379 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.120558 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.138874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647243-a076-4e18-a083-629772643a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.139860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647243-a076-4e18-a083-629772643a18 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.140307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647243-a076-4e18-a083-629772643a18 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.140746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647243-a076-4e18-a083-629772643a18 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.141674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647243-a076-4e18-a083-629772643a18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:30.142252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647243-a076-4e18-a083-629772643a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.143701 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4647243-a076-4e18-a083-629772643a18 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.153482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 63/124] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.155007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbbd8a-2bca-494c-a3d6-4be7c7cfc0ed None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.155301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbbd8a-2bca-494c-a3d6-4be7c7cfc0ed None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.155587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbbd8a-2bca-494c-a3d6-4be7c7cfc0ed None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.156835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 64/125] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:30.157532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbbd8a-2bca-494c-a3d6-4be7c7cfc0ed None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.158236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d117e8-aefd-4ff9-8a75-d2ddf182398e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.200934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.202628 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.203266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.203871 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.205200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=be179fe326884c2f8da11aa9a8f4982c) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:30.205742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.207638 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.214400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 62/126] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/role_assignments?user.id=be179fe326884c2f8da11aa9a8f4982c&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.215765 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.282806 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbbd8a-2bca-494c-a3d6-4be7c7cfc0ed None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.287471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.331584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.332498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.332782 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.333080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.334379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.335664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8e9e-8f23-4a4f-80df-b3074bd2a326 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.336019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940df39-f84e-4924-9122-1c583ba32efb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.337921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 65/127] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.339373 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.339665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.339965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.363673 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:30.364995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:30.377984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.379406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.379983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.380521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.382121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.384254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.386747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 63/128] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.388076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.428335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.455925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 66/129] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:30.456633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.565509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bc41c-0679-4bc8-9439-dfa845d175fe None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.573270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc914b5-114d-484d-a8ec-71a3d95a50b8 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.618136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.631174 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.632095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.632386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.632671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/f100ebbb9b184141b0c51253d104fc9a/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.635496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, user_id=f100ebbb9b184141b0c51253d104fc9a, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.637482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.643905 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.644850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.645133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.645467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.647102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:30.649641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:30.651171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 67/130] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:30.651738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.667997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 64/131] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:30 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/f100ebbb9b184141b0c51253d104fc9a/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:30.668894 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:30.730464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:30.787541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d705-21fb-4ac3-897b-2edfa9bd8c27 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:30.832740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:30.833599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:30.833887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:30.834173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:30.859126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:30.878224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:30.879368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:30.880309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 68/132] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:30.886419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.000470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa578-62f6-4de1-98f0-a0b7aeba4d34 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.063726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b065bd-40eb-4f55-8bb3-947858618b01 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.066828 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.067765 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.068060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.068342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/ad3237a70cf647d2954966a44b02415b/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.071304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, user_id=ad3237a70cf647d2954966a44b02415b, role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.072839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.075035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.093911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 65/133] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:30 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/ad3237a70cf647d2954966a44b02415b/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:31.109781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.110506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.110827 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.111163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.112032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:31.112357 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.113859 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.124441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 69/134] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.130853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.192728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.251459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d705c-1dc2-4e51-8581-6508cb762083 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.288693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.289601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.289964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.290255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.291588 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.293082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.294843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 66/135] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.300914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.409055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213341-6d9f-4a78-b924-15f22a025530 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.445550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.446446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.446761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.447044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] PATH_INFO: `/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.448382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ed2838c2d954ae69bfa9b34cbc1344a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.449914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e181389-4c08-4181-81e1-6364200344e7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.451781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 70/136] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:31 2022] GET /identity/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:31.459836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:31.567018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa1f61-5b13-49e1-b09b-4dfa0540ceb5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:31.584979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:31.603108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:31.603999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:31.604291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:31.604577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] PATH_INFO: `/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a/users/ad3237a70cf647d2954966a44b02415b/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:31.606622 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ed2838c2d954ae69bfa9b34cbc1344a, user_id=ad3237a70cf647d2954966a44b02415b, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:31.608129 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952014f-9923-404f-9a23-d7bc8c27bdf8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:31.627930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 67/137] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:31 2022] PUT /identity/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a/users/ad3237a70cf647d2954966a44b02415b/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:32.066760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54a49-f45e-4644-a74d-34fd5b0d2eef None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.067332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54a49-f45e-4644-a74d-34fd5b0d2eef None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.067332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54a49-f45e-4644-a74d-34fd5b0d2eef None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.069050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 71/138] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:32.074834 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.075341 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.075432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.095438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:32.096707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:32.167715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 68/139] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:32.208210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54a49-f45e-4644-a74d-34fd5b0d2eef None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.252647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:32.321556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54a49-f45e-4644-a74d-34fd5b0d2eef None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.356952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.357765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.358054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.358333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.359712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.361228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f2d72-9d6b-4f67-b987-aaf2245b7ffe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:32.366810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 72/140] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:32.369017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:32.538480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a60e99-ac49-43ba-a02d-b0a00d2096c2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:32.557391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:32.591759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:32.592377 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.592662 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.592947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.593705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:32.595581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d0982-fd4c-4fdb-b3b9-20bdaae6f08f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:32.621067 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 69/141] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:32 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:32.746798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0c77-aae7-4b05-9593-8f06e73d3709 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.747489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0c77-aae7-4b05-9593-8f06e73d3709 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.747986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0c77-aae7-4b05-9593-8f06e73d3709 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.750131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 73/142] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:32.755731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:32.756060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:32.756316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:32.783017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:32.784223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:32.874635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 70/143] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:32.906333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0c77-aae7-4b05-9593-8f06e73d3709 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.045024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0c77-aae7-4b05-9593-8f06e73d3709 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.048030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:33.084503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.085352 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.085643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.085919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.100458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:33.108439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:33.110348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:33.111450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 74/144] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:33.116497 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.232327 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:33.240552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e878b2d-bfeb-437f-9007-c88fcc8b652d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.281462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.282279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.282558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.282894 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.283789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:33.284093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:33.285744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:33.295109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 71/145] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:33.302955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.444997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f15c-aa24-4c16-9c2b-6ecab37df731 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.489794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.490640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.491071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.491592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.493901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:33.495552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:33.497334 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 75/146] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:33.503338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.626506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1cf7-bc15-4a1f-9190-7381ab70aeca None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:33.670059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:33.670739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.671033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.671319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.702723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:33.762430 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:33.763861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11bd27-7f49-41bd-8d14-d7799d183a1f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:33.904515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 72/147] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:33.910181 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:33.938678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa470b-39bd-4052-b061-45d3ab267a4b None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.939032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa470b-39bd-4052-b061-45d3ab267a4b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.939275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa470b-39bd-4052-b061-45d3ab267a4b None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.940688 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 73/148] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:33.946788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31422681-4046-461c-9c79-57f73978d12f None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:33.947120 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31422681-4046-461c-9c79-57f73978d12f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:33.947382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31422681-4046-461c-9c79-57f73978d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:33.977243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-31422681-4046-461c-9c79-57f73978d12f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:33.978511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-31422681-4046-461c-9c79-57f73978d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:33.979087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.094453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.117271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 74/149] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:34.138853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7def91e-9fd8-40ee-99dc-254c7fefe675 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.155335 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31422681-4046-461c-9c79-57f73978d12f None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.193292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.194197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.194483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.194786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.197470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.199045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.200773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 76/150] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:33 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:34.206644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.325068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31422681-4046-461c-9c79-57f73978d12f None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.395662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.396043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.397854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.398448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.399072 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.399211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734a4c3-d224-4cff-874b-04c6d5b23acd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.423042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-04e33ebd-87b9-4bed-9e9d-09dde5ffeeaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:34.431958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:34.433197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:34.434134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:34.436862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 75/151] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:34.438644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583cda7-b5fb-45eb-81bb-a3efbb585b9b None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.440032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583cda7-b5fb-45eb-81bb-a3efbb585b9b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.440540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583cda7-b5fb-45eb-81bb-a3efbb585b9b None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.442534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 76/152] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:34.443723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583cda7-b5fb-45eb-81bb-a3efbb585b9b None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.464112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.464806 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.465093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.465366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.466854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:34.467178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.469259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b4fb9-6eb8-4c1f-97b3-dcf8c7e8968b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.489635 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 77/153] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:34.490828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408e8a-0264-494f-978e-3a50c37c8cd1 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.491118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408e8a-0264-494f-978e-3a50c37c8cd1 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.491404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13408e8a-0264-494f-978e-3a50c37c8cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.523918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-13408e8a-0264-494f-978e-3a50c37c8cd1 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:34.525336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-13408e8a-0264-494f-978e-3a50c37c8cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:34.573971 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.657985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 78/154] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:34.659482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f686a6-1621-4151-a378-2bb5e2deed1f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.660035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f686a6-1621-4151-a378-2bb5e2deed1f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.660483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f686a6-1621-4151-a378-2bb5e2deed1f None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.666199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 79/155] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:34.667161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583cda7-b5fb-45eb-81bb-a3efbb585b9b None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.667983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.668274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.668550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.700594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:34.702058 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:34.713596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.714601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.715060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.715487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.716420 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] RBAC: Adding query filter params (name=reader) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:34.716903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:34.718674 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:34.729097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 77/156] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:34.730272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.779598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 80/157] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:34.787960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.822712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.840403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddfcd-dc45-4248-94b8-b62b763fd89e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:34.851822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:34.881512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:34.882726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:34.883314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:34.883874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:34.897316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:34.906585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:34.907704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:34.908660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:34.911333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 78/158] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:34.912445 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:34.964211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46fec6-5b69-4355-b606-2e915c35ab47 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.029811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d39c0-b02f-43da-897e-5a0a09598964 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.036000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.036911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.037191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.037466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] PATH_INFO: `/v3/users/be179fe326884c2f8da11aa9a8f4982c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.043479 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=be179fe326884c2f8da11aa9a8f4982c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.045000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.046743 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 81/159] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/users/be179fe326884c2f8da11aa9a8f4982c => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.047522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.070584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.071821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.072484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.072986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.084548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:35.093013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:35.094190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:35.095466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:35.098085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 79/160] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:35.099155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.130254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.216740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdfd35-f6d7-46c3-9b17-3397fd0974cc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.260439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.261729 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.262251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.262773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.264267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.266003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.268051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 80/161] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.269044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.291104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.311950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364ad8-1a12-434a-91f2-62573a86fcb1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.375619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.383529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea07ed-49b7-44a7-9d42-c972b912374b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.408076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.408773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.409060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.409341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.410118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:35.410427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.411900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.420899 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.421613 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.421900 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.422185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.422987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:35.423301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.424694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.429045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 82/162] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.429658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.438254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 81/163] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.439778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.567217 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01821098-7861-4e7b-9ad8-7ad9a35bae7a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.614748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.615651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.615940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.616220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.617466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.618969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.621044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 82/164] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.621864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.656133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.668826 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162062-4c46-4a69-b6a1-96970b383ab6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.736729 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522027-1f12-4dff-bb79-4c5af5393cda None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.760813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.761808 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.762005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.762285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/be179fe326884c2f8da11aa9a8f4982c/roles/ecee8366dd6742319b3fc602ac113e8e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.768045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, user_id=be179fe326884c2f8da11aa9a8f4982c, role_id=ecee8366dd6742319b3fc602ac113e8e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.769565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a68ab-893c-47e4-a014-d63767379aa2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.774905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.776054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.776513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.776957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] PATH_INFO: `/v3/users/f100ebbb9b184141b0c51253d104fc9a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.778328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] RBAC: Authorizing `identity:get_user(user_id=f100ebbb9b184141b0c51253d104fc9a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:35.779973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:35.781824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 83/165] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/users/f100ebbb9b184141b0c51253d104fc9a => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:35.782838 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.806129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 83/166] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:35 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/users/be179fe326884c2f8da11aa9a8f4982c/roles/ecee8366dd6742319b3fc602ac113e8e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:35.807554 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe266ec-1e77-430a-a6eb-05dea1b55200 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.807844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe266ec-1e77-430a-a6eb-05dea1b55200 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.808122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe266ec-1e77-430a-a6eb-05dea1b55200 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:35.809445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 84/167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:35.810172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe266ec-1e77-430a-a6eb-05dea1b55200 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:35.857747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.892044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:35.900014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92abad-8a0a-4ea8-98e4-1a40c06a74ab None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:35.937359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:35.938058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:35.938351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:35.938636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.012556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.014071 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6e822-5b0f-4c70-a7c9-642975f65a8e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.115598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe266ec-1e77-430a-a6eb-05dea1b55200 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.117534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.122031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 84/168] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:36.123458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.128687 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.129015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.146449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:36.147700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:36.152801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.153477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.153760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.154040 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.220812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 85/169] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:36.221688 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.225314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.226884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.251784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.331829 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da56d-13dd-4303-b78f-0e69dc495450 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.367213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.371434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.372287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.372611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.372903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.374254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.375918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.377688 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 86/170] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.378492 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.401047 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 85/171] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:36.401921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.494553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81722b68-b745-4049-bd3a-faff66da8d3e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.530251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.531100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.531556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.531849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.543047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:36.551133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:36.552192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:36.553124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 87/172] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:36.553889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.606108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b59f-0047-48db-b1bb-48895d17000b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.615074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.633587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.662323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef33b52-d035-4667-9873-c3e12c949390 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.676317 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.676995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.677280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.677556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.678601 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:36.679111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.680759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.696011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 86/173] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.697145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.706178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.707576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.707576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.707785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.709142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.710614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.718748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 88/174] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.718748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.869569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a401f-a6b5-449c-9e90-9bf46dc056da None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.894095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae217eb-8217-47cf-875d-73edad94c9f9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:36.914616 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.915613 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.916066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.916489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.917422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:36.917891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.919505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.928796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 87/175] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:36.930456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:36.936211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:36.973283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:36.973838 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:36.974130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:36.974415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:36.975303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=f100ebbb9b184141b0c51253d104fc9a) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:36.975624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:36.977091 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:36.999547 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 89/176] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/role_assignments?user.id=f100ebbb9b184141b0c51253d104fc9a&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:37.019768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.097379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cce10-69bc-4848-88c1-a967c8f2e559 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.135664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.137011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.137534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.138032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] PATH_INFO: `/v3/users/ad3237a70cf647d2954966a44b02415b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.139644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3237a70cf647d2954966a44b02415b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.141564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.143537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 88/177] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:36 2022] GET /identity/v3/users/ad3237a70cf647d2954966a44b02415b => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:37.152113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.284108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa1b57-9890-4acb-9c60-ee6911d40e2f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.343341 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.344032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.344321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.344606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.413505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.438440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.439986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f2f5-66c8-4ee7-8eec-7324c1f8a775 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.554809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 90/178] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:37.560492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.682761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556fd52-b3b4-4b63-9739-359692ba71c8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.692441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.718535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1fa-d70c-4606-a70f-538fc7959899 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.718902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1fa-d70c-4606-a70f-538fc7959899 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.719137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1fa-d70c-4606-a70f-538fc7959899 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.721038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 91/179] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:37.729167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.729167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.729167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.729507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.729611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] PATH_INFO: `/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.729702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.729702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.729843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ed2838c2d954ae69bfa9b34cbc1344a)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.730296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.736585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 89/180] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/projects/4ed2838c2d954ae69bfa9b34cbc1344a => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:37.737795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.757364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:37.759227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:37.860002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 92/181] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:37.886947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:37.903098 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:37.944892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1c5d-49b5-4dfa-b940-c8f0065b43a7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:37.987080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:37.987771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:37.988042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:37.988546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:37.989603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=4ed2838c2d954ae69bfa9b34cbc1344a, user.id=ad3237a70cf647d2954966a44b02415b) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:37.990080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:37.991770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74412d17-1666-493f-aae1-88c3c563f5c8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:37.992140 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29c410-3d07-4d93-9a0b-505c96ccd886 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.002797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 90/182] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/role_assignments?user.id=ad3237a70cf647d2954966a44b02415b&scope.project.id=4ed2838c2d954ae69bfa9b34cbc1344a&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.024199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dda95-5c1e-4b85-92c3-1a86a0556f8e None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.024769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dda95-5c1e-4b85-92c3-1a86a0556f8e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.025204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dda95-5c1e-4b85-92c3-1a86a0556f8e None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.030829 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 91/183] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:38.038344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078654f-4a05-45cc-a44b-426094c4635a None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.039059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078654f-4a05-45cc-a44b-426094c4635a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.039553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078654f-4a05-45cc-a44b-426094c4635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.044092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.045203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.045643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.046066 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.057977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:38.066171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:38.067458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:38.068591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:38.071065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 93/184] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:38.075155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1078654f-4a05-45cc-a44b-426094c4635a None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:38.076617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.078251 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1078654f-4a05-45cc-a44b-426094c4635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:38.125675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.166914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.178199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 92/185] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:38.180441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea70f-0471-4778-a318-aca67ab9898d None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.180985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea70f-0471-4778-a318-aca67ab9898d None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.181520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea70f-0471-4778-a318-aca67ab9898d None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.183196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 93/186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:38.196599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.197319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.197992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.216197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4d2fc-57d6-48c8-97dd-f6f310f2e9f1 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.220310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:38.220760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:38.266836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.268671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.269198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.269724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.270762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:38.271297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.272942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.289083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 94/187] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.289083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.310723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 94/188] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:24:38.311685 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.421171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ddff-3c67-428a-b227-4186f11421d5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.434437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.438798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3ac0b-56d7-4cd4-823c-1a7fc12fd3d2 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.455132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.455836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.456118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.456621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.457554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.459051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.465156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 95/189] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.465156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.468492 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.481715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.482608 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.482949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.483218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.497877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.499471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.505954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 95/190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.506835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.576348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba63672-7751-49ff-9c3f-44b41ecd80da None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.612339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592bbbd-dc92-424e-9cba-37e49a63986a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.614792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.615889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.616174 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.616449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.628218 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:38.636355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:38.637389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 96/191] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:38.638357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.656153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.656986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.657278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.657524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.658250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.659757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.694719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 96/192] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:38 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:38.694719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.712601 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.721733 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:38.776682 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312611c-cb4b-4069-bd2a-9696668bf051 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.819245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da9714-79de-4b9f-8097-2ec9cc4bcac3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:38.834228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.835689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.836219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.837233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.859865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:38.860560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:38.860852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:38.861178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:38.861956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:38.862267 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.863811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.874067 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 97/193] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:38.879476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:38.936739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:38.938985 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78092e-c8f1-485a-bc8a-c717c92d60b8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:38.984521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.017488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.021186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867237b-b303-4f2e-b80d-3895cb1eeba5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.064330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 97/194] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:39.065844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.066812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5721-6508-4c76-930f-b228a971b163 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.067104 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5721-6508-4c76-930f-b228a971b163 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.067382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5721-6508-4c76-930f-b228a971b163 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.067744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.068240 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.068721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.070228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.072077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec0d11-ff7b-44e5-86d6-4b164e4a6e67 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.073352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 98/195] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:39.074206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c5721-6508-4c76-930f-b228a971b163 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.074438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 98/196] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:38 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:39.076064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.076571 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.077104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.095877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:39.097564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:39.179928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 99/197] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:39.180797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.213167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c5721-6508-4c76-930f-b228a971b163 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.252515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.253300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.253598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.253861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.255121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.256700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.258523 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 99/198] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:39.259334 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.295658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.299767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.333499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217831e-ca7f-4086-bc3f-e807cc239c33 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.382427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1715ab-60e2-47d7-9b84-410b6fb6eda5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.385063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.385734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.386018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.386296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.429723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.431341 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.432206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.432975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.447642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:39.457519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:39.458310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:39.459368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:39.460298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:39.460997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.463592 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 100/199] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:39.469375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.557149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.584028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.585501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 100/200] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:39.591147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.595579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb18b3-3ae4-485b-aea1-382e0b13dec2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.643258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.644588 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.645512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.645997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.647087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=4305bdbfea5d46159c4cabf19210e691) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:39.647610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.650115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.659169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 101/201] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/role_assignments?user.id=4305bdbfea5d46159c4cabf19210e691&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:39.660363 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.698384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3f286-a290-4f55-9a25-8e56391fa8cf None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.737034 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.738154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.738677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.739128 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.740141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:39.740621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.742321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.752592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 101/202] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:39.758851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.798309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16951a-d1fe-47d6-8bdd-035ffd74a711 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:39.813355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.881916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:39.883166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:39.883603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:39.884029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:39.886080 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:39.889585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:39.897565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 102/203] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:39.904800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:39.948978 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:39.957761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d64d2-0c49-40be-8086-83228716e678 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.008226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.009645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.010174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.010789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] PATH_INFO: `/v3/users/be179fe326884c2f8da11aa9a8f4982c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.012402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] RBAC: Authorizing `identity:get_user(user_id=be179fe326884c2f8da11aa9a8f4982c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.014734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.017626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 102/204] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/users/be179fe326884c2f8da11aa9a8f4982c => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:40.023403 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:40.084949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17441050-8e28-4743-984d-ece399fc8c67 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.143204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de4c1e-7f2b-4168-af7c-b67bd576e532 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.146548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:40.181628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.182769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.183352 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.183970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.195149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.195851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.196149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.196433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.197627 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=4305bdbfea5d46159c4cabf19210e691) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:40.197830 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.199504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.210739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 103/205] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:39 2022] GET /identity/v3/role_assignments?user.id=4305bdbfea5d46159c4cabf19210e691&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:40.299250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.301135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.454506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 103/206] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:40.460768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:40.595274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:40.610705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d050d9-4cd9-45e3-94ad-df3d51807cb6 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.660778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.661661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.661939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.662212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.663463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.664902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f28f-4889-468b-a988-3ab2d5b53c55 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.666715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 104/207] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:40 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:40.672858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:40.687132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:40.841669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6990abb-7833-4491-8bab-bc6a119c287e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:40.884169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:40.884983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:40.885309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:40.885592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:40.886540 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea, user.id=be179fe326884c2f8da11aa9a8f4982c) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:40.886931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:40.888484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d86e9-8b74-475b-bd5f-44c38d8c800b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:40.895504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 104/208] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:40 2022] GET /identity/v3/role_assignments?user.id=be179fe326884c2f8da11aa9a8f4982c&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:41.385539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fa80-07fe-4712-9bdf-db1d9276e96e None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.385904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fa80-07fe-4712-9bdf-db1d9276e96e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.386160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37fa80-07fe-4712-9bdf-db1d9276e96e None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.387939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 105/209] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:41.393001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72f605-3096-44e9-8fd4-fd004af72c0c None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.393550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72f605-3096-44e9-8fd4-fd004af72c0c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.394055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72f605-3096-44e9-8fd4-fd004af72c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.416430 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-3b72f605-3096-44e9-8fd4-fd004af72c0c None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:41.417988 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-3b72f605-3096-44e9-8fd4-fd004af72c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:41.490987 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:41.498169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 105/210] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:41.522375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37fa80-07fe-4712-9bdf-db1d9276e96e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:41.533856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691df6-aa89-44a6-b46b-020d876b75b5 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.534193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691df6-aa89-44a6-b46b-020d876b75b5 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.534436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a691df6-aa89-44a6-b46b-020d876b75b5 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.536138 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 106/211] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:41.541365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.541658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.541938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.561208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:41.562783 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:41.650835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 107/212] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:41.664798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37fa80-07fe-4712-9bdf-db1d9276e96e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:41.674350 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:41.719302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:41.720470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.720799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.721068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.722259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:41.724285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:41.726584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 106/213] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:41.732163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:41.775216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:41.789385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5af75-30f1-4cd6-81e1-d84b067f34f0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:41.817261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:41.826954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:41.827912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.828330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.828766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.840232 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:41.843058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718a3d-f56f-4c0b-bbda-7fe45b34eab3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:41.848759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:41.850257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:41.851206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 108/214] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:41.856821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:41.883348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:41.884039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:41.884706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:41.885000 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:41.885823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:41.887709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:41.919042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 107/215] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:41 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:41.971786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea528f7-a3a0-4b63-bd2d-5f9865f3985b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.009310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.010502 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.011046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.011526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.012518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:42.013036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.014739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.028971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 109/216] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:42.031406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.127313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.148555 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a83b-2917-4539-a089-d4dfc6598705 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.184529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.185452 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.185731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.186055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] PATH_INFO: `/v3/users/b5bd983d9802481599d31ef856645bd9` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.200889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] RBAC: Authorizing `identity:get_user(user_id=b5bd983d9802481599d31ef856645bd9)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.202437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae7b2c-84fe-4c44-957e-a0430dad5c05 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.204645 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 108/217] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/users/b5bd983d9802481599d31ef856645bd9 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:42.210168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.249456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686155b-838f-4c6d-92f6-c3c724e083e1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.249835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686155b-838f-4c6d-92f6-c3c724e083e1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.250046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686155b-838f-4c6d-92f6-c3c724e083e1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.251489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 109/218] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:42.258467 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ab15-127e-4477-991a-2f415932cdca None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.258802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ab15-127e-4477-991a-2f415932cdca None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.259798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ab15-127e-4477-991a-2f415932cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.273073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.283537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0607ab15-127e-4477-991a-2f415932cdca None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:42.284892 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0607ab15-127e-4477-991a-2f415932cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:42.345591 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebc643-cb53-4c6d-b58f-107219bf4295 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.384899 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.385566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.385845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.386120 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.388188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 110/219] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:42.411347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607ab15-127e-4477-991a-2f415932cdca None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.459429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.461198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.485330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.511584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.523261 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607ab15-127e-4477-991a-2f415932cdca None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.560347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.561324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.562057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.562641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.566335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 110/220] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:24:42.572110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.574913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:42.583352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:42.584577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:42.585552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:42.586304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 111/221] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:42.592105 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.678910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2e81-f0e2-4ec4-900b-a6a3931d5c1f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.718084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.719440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.720244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.720727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.722222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.723991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.726226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 111/222] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:42.732316 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.772963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.777396 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b279-2a11-44e1-98b1-7986a0ba97b2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.828689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:42.845522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.846602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.847314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.848540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.849714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:42.850926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.852708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.864843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 112/223] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:42.871275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:42.907992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575f61-1e65-4237-a2d5-52186d3401d0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.950433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:42.951587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.952063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.952547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.953618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=b5bd983d9802481599d31ef856645bd9) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:42.954087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:42.955876 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9eaa6-ac1a-4c4d-a3bb-142ac2d351a5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:42.962938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 112/224] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/role_assignments?user.id=b5bd983d9802481599d31ef856645bd9&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:42.964882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e0da-4a32-4060-b2b5-65ca5992a2b3 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.965411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e0da-4a32-4060-b2b5-65ca5992a2b3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.966010 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793e0da-4a32-4060-b2b5-65ca5992a2b3 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.967685 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 113/225] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:42.973878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:42.974406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:42.975134 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:42.979729 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971ac06-fd00-4445-9e0e-a643d41ec5a0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:42.993450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:42.995012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:43.078158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.080770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.081249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.082070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.084778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.086964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.091785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 113/226] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:42 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:43.096135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.106867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 114/227] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:43.167218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.188906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.197059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.251891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdf7c-99c8-47af-87cc-2851e1582bef None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.316285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.317738 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.318030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.318307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.319586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.322094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.325189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 114/228] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:43.329637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.358360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bff4d1-872b-43a6-944c-0b0980ec8cbe None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.422848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.423685 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.423968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.424246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.436885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:43.446467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:43.449256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:43.451360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 115/229] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:43.454725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.531856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.566778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329a042-54b3-48f2-8d28-130318ca3d8f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.586417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a4bb9-a7ac-44d4-8a84-55241ceb4cfd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.625208 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:43.636570 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.637248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.637530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.637804 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.638570 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:43.638901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.640343 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.646084 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.647054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.647331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.647603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/users/4305bdbfea5d46159c4cabf19210e691/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.653213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, user_id=4305bdbfea5d46159c4cabf19210e691, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.654703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.660332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 116/230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:43.664522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.680255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 115/231] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:43 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/users/4305bdbfea5d46159c4cabf19210e691/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:43.789934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204051e-b39e-4b74-86e1-7ac54db753d9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:43.825005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:43.825913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:43.826193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:43.826458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:43.827835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:43.829458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:43.831243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 117/232] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:43.839874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:43.980695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355969c-54bb-4381-83b7-b17498ec620b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.018132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.019032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.019311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.019581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.020781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.022239 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c6abb-5fc0-4a34-a624-3f4e79c7cf4b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.024354 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 116/233] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:43 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:44.029962 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.033508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.177671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e905c46-50c5-4bae-902d-e18ed205bd00 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:44.228501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:44.229459 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.229789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.230070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/users/4305bdbfea5d46159c4cabf19210e691/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.232412 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, user_id=4305bdbfea5d46159c4cabf19210e691, role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:44.233944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0684e4d-a7ea-47a0-a8c8-1ca57de7bf91 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:44.252491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 118/234] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:44 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/users/4305bdbfea5d46159c4cabf19210e691/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:24:44.726277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b7d9b-9663-40ce-a3d7-7eacd244e9ba None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.726970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b7d9b-9663-40ce-a3d7-7eacd244e9ba None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.726970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b7d9b-9663-40ce-a3d7-7eacd244e9ba None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.728648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 117/235] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:44.733938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:44.734228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:44.734506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:44.758026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:44.761077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:44.840216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:44.857494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 119/236] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:44.899373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b7d9b-9663-40ce-a3d7-7eacd244e9ba None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:44.967458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.030920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b7d9b-9663-40ce-a3d7-7eacd244e9ba None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.069324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.070142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.070424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.070712 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.071931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.073481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe92fe1-2f29-4d4f-922e-6e169c71200a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.075531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 118/237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:45.080886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.089527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eeea8-437d-46be-b703-40117d08d115 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.089527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eeea8-437d-46be-b703-40117d08d115 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.089527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eeea8-437d-46be-b703-40117d08d115 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.089527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 119/238] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:45.098134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418879-6089-4452-998d-fa8478f17327 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.098760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418879-6089-4452-998d-fa8478f17327 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.099277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45418879-6089-4452-998d-fa8478f17327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.128730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-45418879-6089-4452-998d-fa8478f17327 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:45.130433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-45418879-6089-4452-998d-fa8478f17327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:45.189611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52013e3-dfc1-47f4-af70-bae040db0f90 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.240689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 120/239] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:45.244891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.245579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.245863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.246142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.246918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.248471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.270274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 120/240] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:45 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:45.281160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418879-6089-4452-998d-fa8478f17327 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.376936 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.434366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45418879-6089-4452-998d-fa8478f17327 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.473746 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af854102-338c-4223-ac03-d16f5159225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.474616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854102-338c-4223-ac03-d16f5159225f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.474953 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854102-338c-4223-ac03-d16f5159225f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.475231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854102-338c-4223-ac03-d16f5159225f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.497313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af854102-338c-4223-ac03-d16f5159225f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-af854102-338c-4223-ac03-d16f5159225f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:45.505379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:45.506513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:45.507506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 121/241] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:45.512848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.604621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.670657 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865492-7a55-4369-a4c1-d89bd86db589 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.678321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c395e4-ceeb-4c40-860b-e714b52ba99e None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.678620 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c395e4-ceeb-4c40-860b-e714b52ba99e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.678954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c395e4-ceeb-4c40-860b-e714b52ba99e None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.680686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 122/242] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:45.685671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.685998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.686253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.710930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:45.712831 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:45.713677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.714641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.715214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.715718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.716720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:45.717039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.718470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.732447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 121/243] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:45.739013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.818549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 123/244] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:45.842511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.868428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619af31-4190-4333-b978-207e1d049e6d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:45.884674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.911901 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:45.929774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:45.931028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:45.931566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:45.931992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] PATH_INFO: `/v3/users/7c9765fcc17d440580ee12f8cbae1bfb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:45.952055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9765fcc17d440580ee12f8cbae1bfb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:45.954138 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:45.961509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 122/245] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/users/7c9765fcc17d440580ee12f8cbae1bfb => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:45.964314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:45.995215 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db86ee-7d67-4c71-9280-a5193ea2eb37 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.038936 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.039859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.040151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.040433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.053479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:46.063701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:46.065023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:46.066142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:46.069456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 124/246] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:46.076058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:46.127165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b58c5-e555-4586-bde7-1776af574a94 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.188805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.189471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.189752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.190026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.199713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcb7e8-9d13-4696-96b6-9dcdc3ec773c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.206997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:46.248412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.249413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.249952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.251052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.252261 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:46.252857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:46.254808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:46.265237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 125/247] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:46.271272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:46.304499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:46.400786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:46.402493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:46.422007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaaf63-1b1c-4786-8de8-69cb4a1937c5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.495434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.497369 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.497879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.498384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] PATH_INFO: `/v3/users/b5bd983d9802481599d31ef856645bd9` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.499962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] RBAC: Authorizing `identity:get_user(user_id=b5bd983d9802481599d31ef856645bd9)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:46.501686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:46.503945 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 126/248] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:46 2022] GET /identity/v3/users/b5bd983d9802481599d31ef856645bd9 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:46.510216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:46.571224 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:46.637086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 123/249] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:46.656358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:46.708468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531de8f-b0ae-4f51-9e8e-e4019670fe68 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.781446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.782352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.782641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.782946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.787023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:46.788040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:46.790015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:46.792876 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 127/250] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:46 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:46.799192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:46.860037 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396c8f-8fe4-4437-bfb8-65d81e1d4f0a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.951543 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:46.952349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.952632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.952907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.954182 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:46.955722 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239af32a-93fc-4105-982b-9d26affc0584 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:46.960863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 124/251] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:46 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:46.960863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901752-4395-4bf6-a82c-9154960d7633 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.960863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901752-4395-4bf6-a82c-9154960d7633 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.960863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901752-4395-4bf6-a82c-9154960d7633 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.960863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 125/252] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:46.961786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:46.967583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13115d49-0fa3-4367-a5a3-14955ebbf182 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:46.972264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:46.972554 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:46.972839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:46.996481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:46.997667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:47.020455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.021366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.021652 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.021927 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/users/b5bd983d9802481599d31ef856645bd9/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.024149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, user_id=b5bd983d9802481599d31ef856645bd9, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.025682 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.047018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 128/253] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:46 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/users/b5bd983d9802481599d31ef856645bd9/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:47.048299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.165729 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 126/254] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:47.196699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.223955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbf48-2ea4-4c8c-993e-081e2471c023 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.265291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.265974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.266259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.266539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.267433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=7c9765fcc17d440580ee12f8cbae1bfb) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:47.267752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.269388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71268844-f505-4ef5-88fb-d68122749146 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.276034 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 129/255] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/role_assignments?user.id=7c9765fcc17d440580ee12f8cbae1bfb&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:47.331617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.397156 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabdab-f5fa-4212-b8b5-f559ba0058cc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.449226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.450327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.450779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.451226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.470632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:47.471968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a669-9d75-44b8-8830-777b2a1ff9d0 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.472364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a669-9d75-44b8-8830-777b2a1ff9d0 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.472747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a669-9d75-44b8-8830-777b2a1ff9d0 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.474556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 130/256] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:47.479737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.480152 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.480569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:47.481667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.482967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:24:47.483957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:47.486126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 127/257] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:47.492327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.504166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:47.505524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:47.532228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.600259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 131/258] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:47.629266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.698511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded41c-d5b2-4713-adfe-f2fae5c0afcf None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.750165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a2542-3246-429a-a4a8-c9aef7c90949 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.768641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.789368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.790181 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.790471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.790853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.791743 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:47.791878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.792052 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.792790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.793135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.793474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.793594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:47.805092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:47.810832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 128/259] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:47.811982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:47.813981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:47.815083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:47.817704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 132/260] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:47.826708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:47.838951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:47.935294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ba99d-867d-4dad-aef4-d5dae8794e96 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:47.976418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:47.977264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:47.977444 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:47.982711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:47.982711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:47.982711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:47.982711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.005393 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 133/261] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:48.010847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1251e1-633e-4b10-8bc3-f9092c1249cb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.013337 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.097919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.098844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.099129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.099408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.104981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.106495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.110365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 129/262] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:47 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:48.119879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.201896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.225602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95b65c-0774-41a0-8d59-4aa45519871d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.267867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.282943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.283842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.284122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.284397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] PATH_INFO: `/v3/users/4305bdbfea5d46159c4cabf19210e691` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.289563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] RBAC: Authorizing `identity:get_user(user_id=4305bdbfea5d46159c4cabf19210e691)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.291101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.293128 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 134/263] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/users/4305bdbfea5d46159c4cabf19210e691 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.298788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.404653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a5678-fb23-424e-a357-895781797ee8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.413356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2ee8e-57f2-4dcc-ac07-5ca625e4e009 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.449409 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.450399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.450883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.451308 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.479103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.487387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.488049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.488329 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.488600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.526316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.532733 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10804f98-e95c-4e75-a14c-ea87315d7cfc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.575320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.577166 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45458-db10-4b09-923e-5badb302dc5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.668504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.745086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 130/264] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:48.746913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38163c-ba1b-4385-9250-af6816826082 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.747445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38163c-ba1b-4385-9250-af6816826082 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.747930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38163c-ba1b-4385-9250-af6816826082 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.749744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 131/265] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:48.750650 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38163c-ba1b-4385-9250-af6816826082 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.759096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 135/266] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:48.760581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.760884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.761168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.803903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:48.805039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:48.863419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38163c-ba1b-4385-9250-af6816826082 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:48.887249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:48.913112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734225-9702-4c50-a71b-c26806414889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:48.914003 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734225-9702-4c50-a71b-c26806414889 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:48.914283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734225-9702-4c50-a71b-c26806414889 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:48.914557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734225-9702-4c50-a71b-c26806414889 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:48.916652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02734225-9702-4c50-a71b-c26806414889 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:48.918193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02734225-9702-4c50-a71b-c26806414889 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:48.920613 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 132/267] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:48.921454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734225-9702-4c50-a71b-c26806414889 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.953043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 136/268] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:48.954030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:48.963303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.074420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02734225-9702-4c50-a71b-c26806414889 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.137551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.138437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.138735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.139013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.140442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.141966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.144691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 133/269] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.145512 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.155465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857851-0ed0-4bf4-9151-fd7f8b239dcc None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.199365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.200306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.200785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.201229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.202256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=4305bdbfea5d46159c4cabf19210e691) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.202773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.204451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a8a5-76ad-4edf-be17-06ac447aa7a8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.211599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 137/270] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:48 2022] GET /identity/v3/role_assignments?user.id=4305bdbfea5d46159c4cabf19210e691&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.218731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d909-179d-4c21-a980-97ae07704aa8 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.219847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d909-179d-4c21-a980-97ae07704aa8 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.220289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36d909-179d-4c21-a980-97ae07704aa8 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.221951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 138/271] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:49.227098 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36d909-179d-4c21-a980-97ae07704aa8 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.271922 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.286818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fbf7f-da6a-4c38-aee7-4fea9a4628af None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.312339 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.364403 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.366019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.366726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.368579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.392386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c3b90d2d-2220-45d1-859a-94eaba70465d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:49.409347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:49.410462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:49.411483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:49.418259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 134/272] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:49.424610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.426770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.428354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.460266 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:49.461463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:49.475503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36d909-179d-4c21-a980-97ae07704aa8 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.517202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.518924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.520011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.520552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.521819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=4305bdbfea5d46159c4cabf19210e691) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.522381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.525005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.533517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 139/273] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/role_assignments?user.id=4305bdbfea5d46159c4cabf19210e691&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.538865 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.572503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 135/274] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:49.652371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.716862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae79f5-0150-47af-be63-8f78794f0edb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.718904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.780644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:49.800038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.800737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.801020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.801294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.802058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:49.802362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.803790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.806822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679871-fb2f-41ee-ae8c-1ba7fcdbf3bf None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:49.821933 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 140/275] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:49.830806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.861647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:49.862461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:49.862804 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:49.863058 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] PATH_INFO: `/v3/domains/default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:49.864381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:49.866028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:49.868162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 136/276] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:49.875140 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:49.959641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d85ab-7ef2-43b8-bb17-f7e6e8e8611d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.000203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.001113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.001362 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c51-7e80-4208-8aac-146ecbf1027f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.001488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.001687 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] PATH_INFO: `/v3/users/254ab67d5e0b40408a6d6fcc37807eb1` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.021720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] RBAC: Authorizing `identity:get_user(user_id=254ab67d5e0b40408a6d6fcc37807eb1)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.023311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.025396 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 141/277] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:49 2022] GET /identity/v3/users/254ab67d5e0b40408a6d6fcc37807eb1 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:50.032206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.052206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.053019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.053306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.053585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.054329 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.055866 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ead491-035e-441c-aa4d-ec39998e532e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.059879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.083675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 137/278] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:24:49 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:50.149224 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c234a3-31bf-4138-9d84-91b8a63ed71d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.188606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.189304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.189583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.189809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.190665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, user.id=254ab67d5e0b40408a6d6fcc37807eb1, scope.system=all) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:50.191002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.192506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726b3f-b492-46cc-ba81-2d5698f64c7e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.198972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 142/279] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/role_assignments?user.id=254ab67d5e0b40408a6d6fcc37807eb1&scope.system=all&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:50.204430 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfd2-ca02-4744-9598-6520175c610f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.204784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfd2-ca02-4744-9598-6520175c610f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.204962 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ccfd2-ca02-4744-9598-6520175c610f None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.206832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 138/280] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:50.212454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3311e7-fdf2-44da-abf4-7ac0ae44c7cc None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.212757 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3311e7-fdf2-44da-abf4-7ac0ae44c7cc None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.212915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3311e7-fdf2-44da-abf4-7ac0ae44c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.234143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0e3311e7-fdf2-44da-abf4-7ac0ae44c7cc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:50.235482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0e3311e7-fdf2-44da-abf4-7ac0ae44c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:50.321538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 143/281] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:50.349936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccfd2-ca02-4744-9598-6520175c610f None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.361474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.458387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca305f-c660-4ee9-bfc0-a81cd4d99508 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.458670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca305f-c660-4ee9-bfc0-a81cd4d99508 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.459121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca305f-c660-4ee9-bfc0-a81cd4d99508 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.462135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 144/282] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:50.466353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.466583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.466961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.473094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ccfd2-ca02-4744-9598-6520175c610f None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.489179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:50.490507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:50.505381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.515577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.516738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.517262 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.517745 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.531288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:50.539890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.541200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:50.542320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:50.544053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 139/283] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:50.549874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.581518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 145/284] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:50.605047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.638773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.707472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b225089-86e8-4a75-9711-00b4da334643 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.708596 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c2b44-62ba-489b-81c3-d0fef68cbefb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:50.742839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.743720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.744063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.744405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.760905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:50.774175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:50.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:50.776366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 146/285] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:50.786333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.787338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:50.788026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:50.788304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:50.788577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:50.789349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:50.789662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:50.791225 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:50.811060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:50.811371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 140/286] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:50.816646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:50.970526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cd682-581c-4f07-b4d9-124d581b3888 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.002213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3091-3aee-4845-9e62-9444883f1f3b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.042883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.044201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.044803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.045290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.046297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:51.046845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.048471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.063069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.067454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 147/287] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:51.076020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.091391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.092605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.092889 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.093171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] PATH_INFO: `/v3/users/7c9765fcc17d440580ee12f8cbae1bfb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.099415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9765fcc17d440580ee12f8cbae1bfb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.100948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.102943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 141/288] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:50 2022] GET /identity/v3/users/7c9765fcc17d440580ee12f8cbae1bfb => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:51.113376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.199259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.246398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23c88d-72fd-485d-b7bd-c72150b98e08 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.264898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a41d-3222-4e4a-a7c8-c46f2c240da3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.308955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.311030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.311315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.311593 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.313554 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.315809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.317552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 142/289] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:51.328528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.336684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.337695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.338020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.338314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] PATH_INFO: `/v3/users/b5bd983d9802481599d31ef856645bd9` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.339951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5bd983d9802481599d31ef856645bd9)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.346612 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.348426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 148/290] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/users/b5bd983d9802481599d31ef856645bd9 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:51.354161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.453712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.517362 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43b82-46d4-4882-9378-80c476e4f7fe None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.540810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fd1a9-2fbc-444b-85c7-bec9f1c13de2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:51.578665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.579602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.579882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.580159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/users/7c9765fcc17d440580ee12f8cbae1bfb/roles/ecee8366dd6742319b3fc602ac113e8e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.583498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, user_id=7c9765fcc17d440580ee12f8cbae1bfb, role_id=ecee8366dd6742319b3fc602ac113e8e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.585002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.606386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:51.607083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:51.607378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:51.609803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:51.611082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 143/291] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:24:51 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/users/7c9765fcc17d440580ee12f8cbae1bfb/roles/ecee8366dd6742319b3fc602ac113e8e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:51.620023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:51.711664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:51.713210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:51.858047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 149/292] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:51.864013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:51.972744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ace9c1-cf9a-4e33-aa9c-6d988b4e3f5e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.004530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.016907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.017817 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.018491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.018912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.021065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.022713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7c54-7ef2-4b4a-af38-f0091c8002cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.025008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 144/293] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:51 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:52.031117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:52.073692 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.147647 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9904-7eff-46e0-b367-e78ed1a7207e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:52.190476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:52.191486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.191918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.192350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.193337 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=b5bd983d9802481599d31ef856645bd9) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:52.193813 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:52.195453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1c316-61a0-4c07-b3e7-bbbc41fe619c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:52.208061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 150/294] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/role_assignments?user.id=b5bd983d9802481599d31ef856645bd9&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:52.819081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027695b8-2247-48f6-9387-58342dbc7f80 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.819659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027695b8-2247-48f6-9387-58342dbc7f80 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.819659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027695b8-2247-48f6-9387-58342dbc7f80 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.820994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 145/295] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:52.826487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.826791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.827314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.847258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:52.848787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:52.857279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000dea-c5ec-4348-865d-1a52b0e1e593 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.857877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000dea-c5ec-4348-865d-1a52b0e1e593 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.858257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000dea-c5ec-4348-865d-1a52b0e1e593 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.860023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 146/296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:52.865297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f61c8-59ec-45b6-b444-325575ca514f None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.865692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f61c8-59ec-45b6-b444-325575ca514f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.866196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f61c8-59ec-45b6-b444-325575ca514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.883288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-439f61c8-59ec-45b6-b444-325575ca514f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:52.884910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-439f61c8-59ec-45b6-b444-325575ca514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:52.926725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 151/297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:52.945526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:52.964626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 147/298] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:52.972140 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30167552-47a8-4206-b67a-07626e1b1a87 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.972440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30167552-47a8-4206-b67a-07626e1b1a87 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.972725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30167552-47a8-4206-b67a-07626e1b1a87 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.974169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 148/299] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:52.979619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:52.979763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:52.979947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:52.980180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:52.998368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:52.999790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:53.055103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e40018-a208-4b23-baa0-1f3b101d1350 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.074792 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 149/300] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:53.074792 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.095031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.095955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.096243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.096516 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.107389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:53.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:53.116546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:53.117489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:53.121741 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 152/301] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:53.122592 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.135208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.185623 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177a069-fd45-4747-a935-af56bf312f2f None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.220955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.221510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.221816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.222088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.222592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.232870 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:53.233368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1771f69-51df-4594-be31-af0e210d7016 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:53.240600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:53.241849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 150/302] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:53.243674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.276394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.277221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.277502 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.277773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.279073 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.280996 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.282734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 153/303] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.288342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.357445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7eb0-7762-433a-ac39-5737245bfd99 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.374913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.400485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.401176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.401445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.401726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.402495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.402841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.404303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.406468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8cdc-8bed-48fa-bea5-deb665ae1a69 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.412924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 151/304] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.414019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.447991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.448687 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.448963 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.449237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.450000 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.450313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.452138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.464864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 154/305] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.464864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.489272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.527243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99b44-d4d9-443c-b8ae-6927e4417113 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.562567 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.563746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.564033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.564309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] PATH_INFO: `/v3/groups` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.565016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.566486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.572222 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3088a5-9ca8-4dd0-a823-89616cabfc2e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.590793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 152/306] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 20:24:53 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:24:53.590793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.621761 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.622840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.623200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.623600 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] PATH_INFO: `/v3/users/254ab67d5e0b40408a6d6fcc37807eb1` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.625184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] RBAC: Authorizing `identity:get_user(user_id=254ab67d5e0b40408a6d6fcc37807eb1)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.626782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.628243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.629906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 155/307] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/users/254ab67d5e0b40408a6d6fcc37807eb1 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.636752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.713797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb636501-c29f-4730-bce5-7c04f3f5982a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.760670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.768164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.770153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.770956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.771443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] PATH_INFO: `/v3/users/6495f7d8870945ec9e3e631c2bd3cb59` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.776591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0993fe-d194-4826-9116-6755a6e99a6b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.792636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] RBAC: Authorizing `identity:get_user(user_id=6495f7d8870945ec9e3e631c2bd3cb59)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.794959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.797341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 153/308] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/users/6495f7d8870945ec9e3e631c2bd3cb59 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:53.803385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:53.826511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.828801 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.831123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.831480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] PATH_INFO: `/v3/system/users/254ab67d5e0b40408a6d6fcc37807eb1/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.833794 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=254ab67d5e0b40408a6d6fcc37807eb1, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.834905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bf3c4-9d3a-4f4b-9037-64c740baf9f3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.846200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 156/309] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 20:24:53 2022] PUT /identity/v3/system/users/254ab67d5e0b40408a6d6fcc37807eb1/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:24:53.930372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:53.940972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e0678-b42f-4998-a392-66e1268154a6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:53.983747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:53.984437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:53.984720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:53.984998 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:53.985856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, user.id=6495f7d8870945ec9e3e631c2bd3cb59, scope.system=all) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:53.986170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:53.987738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f5ee2-0b5e-417d-87d2-c347f95d3f14 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:53.994184 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 154/310] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:24:53 2022] GET /identity/v3/role_assignments?user.id=6495f7d8870945ec9e3e631c2bd3cb59&scope.system=all&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:54.400704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29c09-5e3e-482d-b6cb-9f1dfdec367d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.401229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29c09-5e3e-482d-b6cb-9f1dfdec367d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.401229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29c09-5e3e-482d-b6cb-9f1dfdec367d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.402975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 157/311] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:54.408495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.408790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.409069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.425815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:54.427030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:54.497147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 155/312] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:54.520521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29c09-5e3e-482d-b6cb-9f1dfdec367d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.627795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29c09-5e3e-482d-b6cb-9f1dfdec367d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.663471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.664279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.664563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.664845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.675513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:54.683285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:54.684315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:54.685213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 158/313] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:54.690741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.774458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.792358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979354-81e4-455c-8345-6f6b9bbf471b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:54.829746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:54.830429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:54.830724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:54.831000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:54.831764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:54.832071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:54.833493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:54.842776 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 156/314] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:54.851787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:54.868378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:54.969166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944737ca-5ee0-4550-b578-b5245065a313 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.005809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.006725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.007018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.007301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] PATH_INFO: `/v3/users/7c9765fcc17d440580ee12f8cbae1bfb` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.008542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9765fcc17d440580ee12f8cbae1bfb)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.010017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.012025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 159/315] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:54 2022] GET /identity/v3/users/7c9765fcc17d440580ee12f8cbae1bfb => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.019820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.128795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa71518-708a-4a82-8721-4132972284fa None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.163065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.163725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.164008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.164284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.184518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.238160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.239633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.352430 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 157/316] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:55.358040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.445162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.465578 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cbb31-196d-49ef-8557-52da8d88cd63 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.500413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.501199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.501479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.501755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.502986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.504442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e30fb-4897-4208-854b-3ebb9ad4e7ad None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.506155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 160/317] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.512147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:55.563414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:55.621189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739564b-7f0a-4b89-86e7-d5bb385e542d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:55.663400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:55.664076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.664363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.664645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.665537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, scope.project.id=caf820f64ea84c0e8813051c8a016284, user.id=7c9765fcc17d440580ee12f8cbae1bfb) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:55.665854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:55.667391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8661ec-27b1-4717-bbc9-74f6d83c694a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:55.674109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 158/318] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:24:55 2022] GET /identity/v3/role_assignments?user.id=7c9765fcc17d440580ee12f8cbae1bfb&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:55.955684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf8a3-d010-4697-9e9d-33b429a81289 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.956489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf8a3-d010-4697-9e9d-33b429a81289 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.956992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecf8a3-d010-4697-9e9d-33b429a81289 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.958954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 161/319] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:55.964766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d58ff-092a-4eb3-986a-2ab45b580158 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:55.965246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d58ff-092a-4eb3-986a-2ab45b580158 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:55.965684 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d58ff-092a-4eb3-986a-2ab45b580158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:55.983207 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-666d58ff-092a-4eb3-986a-2ab45b580158 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:55.984639 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-666d58ff-092a-4eb3-986a-2ab45b580158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:56.060084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 159/320] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:56.083499 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecf8a3-d010-4697-9e9d-33b429a81289 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.196243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c1f6-ef9e-46c5-858d-ea1572136156 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.196499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c1f6-ef9e-46c5-858d-ea1572136156 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.196800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72c1f6-ef9e-46c5-858d-ea1572136156 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.198406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 160/321] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:24:56.199223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecf8a3-d010-4697-9e9d-33b429a81289 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.203585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.203875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.204159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.222488 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:56.223963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:56.240484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.241292 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.241579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.241857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.244209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.245660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.247546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 162/322] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.252802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.264188 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.273362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.300067 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 161/323] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:56.323717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.365105 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb371b-aab7-420a-afd5-4f2b412426ee None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.398973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.399701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.399987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.400293 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] PATH_INFO: `/v3/groups` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.400985 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.402431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70654c0c-b28f-4f4a-85a6-1d48b5bebcc0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.417566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 163/324] 10.222.0.77 () {60 vars in 1134 bytes} [Thu May 19 20:24:56 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:24:56.418666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc64d5-a114-4de6-8ba6-ca772ecc4d75 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.418978 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc64d5-a114-4de6-8ba6-ca772ecc4d75 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.419262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc64d5-a114-4de6-8ba6-ca772ecc4d75 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.420506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 164/325] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:56.428149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.428476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.428742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.441244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026995f-0136-4f2d-adb0-022724f68a8e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.452784 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:56.455562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:56.484460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.485221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.485508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.485823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.498628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:56.506610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.507892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:24:56.512087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 162/326] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:56.513947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.546235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 165/327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:24:56.549994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.569221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.579540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.630132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8cb69-bcf6-420a-ad9d-979a9e6edd0f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.673001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.673683 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.673966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.674243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.675066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.675353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.677318 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.688112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 163/328] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.690835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0a348-ea4e-479a-883d-4dfd74612f1c None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.693930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.733301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.734584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.734851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.735132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.749922 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:56.760535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:56.761633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:56.762621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 166/329] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:24:56.771229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.824434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968fef-3da1-4e3d-b712-a553e43ec3f4 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.826250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.846256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:56.872103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.873411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.873913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.874405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] PATH_INFO: `/v3/users/254ab67d5e0b40408a6d6fcc37807eb1` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.876604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] RBAC: Authorizing `identity:get_user(user_id=254ab67d5e0b40408a6d6fcc37807eb1)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.878298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.880500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 164/330] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/users/254ab67d5e0b40408a6d6fcc37807eb1 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:24:56.892695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:56.894456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315b6e-b6e0-4fd4-86d2-7e5ba71a1858 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:56.933438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:56.934121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:56.934407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:56.934701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:56.935600 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:56.935926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:56.937544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:56.948371 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 167/331] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:56.956569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.010652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e5c0-a0cc-4223-84d1-38afa79b9a82 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.050021 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.050845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.051133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.051523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.052385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] RBAC: Adding query filter params (role.id=99b1f8fc21014350ba9f398b3774c26a, user.id=254ab67d5e0b40408a6d6fcc37807eb1, scope.system=all) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:57.052705 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.054205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.070727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 165/332] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/role_assignments?user.id=254ab67d5e0b40408a6d6fcc37807eb1&scope.system=all&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.099244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a08ec-5f44-4ad6-9325-99e9accc5653 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.129861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.139932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.140904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.141194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.141476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] PATH_INFO: `/v3/users/6495f7d8870945ec9e3e631c2bd3cb59` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.142870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] RBAC: Authorizing `identity:get_user(user_id=6495f7d8870945ec9e3e631c2bd3cb59)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.144375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1bd0-7004-493e-8bbb-5e9c3d5c90f0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.146658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 168/333] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:24:56 2022] GET /identity/v3/users/6495f7d8870945ec9e3e631c2bd3cb59 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:57.152055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:57.182391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:57.289685 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf7b09-e10f-4fd9-a0d4-8a3964da6e2f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:57.333364 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:57.334223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:57.334536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:57.334839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] PATH_INFO: `/v3/system/users/6495f7d8870945ec9e3e631c2bd3cb59/roles/ecee8366dd6742319b3fc602ac113e8e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:57.336578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6495f7d8870945ec9e3e631c2bd3cb59, role_id=ecee8366dd6742319b3fc602ac113e8e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:57.338110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5e3d0-1e58-4d9a-86e3-91451103a80f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:57.351473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 166/334] 10.222.0.77 () {58 vars in 1334 bytes} [Thu May 19 20:24:57 2022] PUT /identity/v3/system/users/6495f7d8870945ec9e3e631c2bd3cb59/roles/ecee8366dd6742319b3fc602ac113e8e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:24:58.969033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47398f-68a0-49b0-9c78-7c0f9202d11b None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.969975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47398f-68a0-49b0-9c78-7c0f9202d11b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.969975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47398f-68a0-49b0-9c78-7c0f9202d11b None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:58.971388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 169/335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:24:58.977109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:58.977579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:58.977677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.000077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:24:59.001359 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:24:59.085079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 167/336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:24:59.125442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47398f-68a0-49b0-9c78-7c0f9202d11b None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.250002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47398f-68a0-49b0-9c78-7c0f9202d11b None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.294967 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.295795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.296074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.296352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.313716 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:24:59.326719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:24:59.327907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:24:59.328842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 170/337] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:24:59.337736 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.379145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.474968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2819b3-08f0-4915-a311-fe93a51aa4b4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.514306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.514912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.515196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.515476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.516248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:24:59.516559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.517983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.527253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 168/338] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:24:59.533027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:24:59.602391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.659082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e372fbf-2810-4ec0-b482-afa4f5a7dc0b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:24:59.701487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:24:59.702162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:24:59.702449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:24:59.702755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:24:59.782815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:24:59.784255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:24:59.856519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:24:59.926119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 171/339] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:24:59.931633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.027114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.050211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bba19b-768b-41fc-b1bb-e3250a0f125c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.091465 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.092405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.092694 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.092974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.094259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.096219 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41460fa5-792e-4190-9d69-9f5175b657a9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.098366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 169/340] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:24:59 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:00.103580 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.219085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc331f-1b1e-4ed4-a8e2-d91ce437c55a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.222278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dcd0-021e-4750-9654-e4b85611c48f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.222567 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dcd0-021e-4750-9654-e4b85611c48f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.222882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72dcd0-021e-4750-9654-e4b85611c48f None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.224369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 170/341] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:00.230298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.230972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.231458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.263822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:00.266322 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:00.289453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.290380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.290667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.290982 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.299371 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.306771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.306771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 172/342] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:00.308647 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.345289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.401590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 171/343] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:00.447809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.466281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b0764-2d6e-4a80-b0ab-f1a09289df7c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.532213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.532906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.533193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.533476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.534344 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:00.534660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.536199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82125-e0c2-44bd-9f0b-6420d631f6cf None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.547181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 173/344] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:00.571739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.572768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bb63-23c0-43dd-a9bc-ebb4bf55f243 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.572768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bb63-23c0-43dd-a9bc-ebb4bf55f243 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.573097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57bb63-23c0-43dd-a9bc-ebb4bf55f243 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.574570 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 174/345] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:00.584273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.584656 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.584831 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.606008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a50f-8d19-4421-9cb4-842ecf91eac5 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.631870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:00.633129 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:00.668606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.669503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.669798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.670074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.686747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:00.699385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:00.700522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:00.701467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 172/346] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:00.706653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.764142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 175/347] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:00.803804 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:00.843230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.849972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e714cc2-7a71-4e6f-b214-c7506246dfb4 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:00.886915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:00.887604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:00.887893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:00.888180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:00.889002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:00.889358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:00.890853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:00.900308 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:00.900643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 173/348] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:00.906742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.029594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfdc02-0a8a-4948-8523-f829f31d4b20 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.076998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cdc5-3422-4205-bf0d-6b905ae7be88 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.095398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.095992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.096275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.096553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.150162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.151007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.151285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.151559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.175457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-75aa6a07-5267-4d69-8690-1535f6804900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:01.189504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.190560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:01.191561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 176/349] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:01.200008 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b385-fc4a-448e-bb51-ce4650fa81dd None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.200294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b385-fc4a-448e-bb51-ce4650fa81dd None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.200574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9b385-fc4a-448e-bb51-ce4650fa81dd None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.203600 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 177/350] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:01.205784 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b385-fc4a-448e-bb51-ce4650fa81dd None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.211521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.225746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.227364 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc67c6-f9eb-4756-aafc-d4fe3d65f4eb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.352368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.370316 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 174/351] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:01.375929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.376223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.376507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.380864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9b385-fc4a-448e-bb51-ce4650fa81dd None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.393974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:01.395210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:01.419715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.420571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.420989 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.421284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.422064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:01.422381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.424445 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fcb40-5a3a-4cf5-bee1-60a526e52fa0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.434875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 178/352] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:01.436655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3870-6f08-4ce6-886b-882505c388c7 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.437176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3870-6f08-4ce6-886b-882505c388c7 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.437642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3870-6f08-4ce6-886b-882505c388c7 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.440841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 179/353] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:01.444306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3870-6f08-4ce6-886b-882505c388c7 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.472482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 175/354] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:01.473356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.511177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.590984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3870-6f08-4ce6-886b-882505c388c7 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.613007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd698b2-8ef9-4fe6-a521-d7655fe6c34e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.645648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.646533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.646926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.647208 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.648991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.650593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7d196-6a6f-4736-b936-094a0b0b4a8b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.652775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 180/355] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:01.653924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8820c9-5c42-48c1-9c88-be5d361e0477 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.654219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8820c9-5c42-48c1-9c88-be5d361e0477 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.654501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8820c9-5c42-48c1-9c88-be5d361e0477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.661969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.663305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.663992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.664386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.664666 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.675374 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-8b8820c9-5c42-48c1-9c88-be5d361e0477 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:01.677450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-8b8820c9-5c42-48c1-9c88-be5d361e0477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:01.757928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:01.759495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:01.770842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 181/356] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:01.772259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd0e19-20e7-4ccf-9d1b-6e19da52dfb6 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.772548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd0e19-20e7-4ccf-9d1b-6e19da52dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.772822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd0e19-20e7-4ccf-9d1b-6e19da52dfb6 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.774179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 182/357] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:01.774969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd0e19-20e7-4ccf-9d1b-6e19da52dfb6 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.797339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.884231 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 176/358] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:01.885603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:01.917367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd0e19-20e7-4ccf-9d1b-6e19da52dfb6 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:01.970146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:01.970372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:01.970599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:01.970932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:01.973015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:01.983488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-3596b8f3-5a5a-4fe3-add5-2c0d86732e1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:01.997629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:01.998970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 183/359] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:01.999888 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.000770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.000770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.010024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44ff0-353a-4baa-bc05-29b872048967 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.019333 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:02.020552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:02.044280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.055691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.056649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.056927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.057196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.058454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.060063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.061769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 177/360] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:01 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.062532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.110400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 184/361] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:02.111787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.193907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde666-21e3-4288-aaad-13ace911df9a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.238520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935242d7-d84c-4bb3-9e1a-c3b93eca0534 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.243245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.244133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.244420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.246719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.258741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:02.268324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:02.269873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:02.271228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 178/362] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:02.273469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.280345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.281505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.282057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.282704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.284091 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.285562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.287730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 185/363] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.288332 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.342492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.402244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d69c8-81b7-489d-9925-6c2f4ca9dbb3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.412598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c40be-40ae-422d-86c3-eaf2715f9302 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.448662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.449272 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.449711 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.449989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.451389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] RBAC: Adding query filter params (name=reader) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.451706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.453124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.455175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.455890 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.456153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.456795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.457658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.457977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.459912 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.463741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 179/364] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.467036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.471852 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 186/365] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.473920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.560737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.619333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fb01-5544-4384-9dc0-1daebee95960 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.644060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.644795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e5af-89cf-49c9-b287-2a6b0aa08ee7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.675077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.675913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.676199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.676476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.691768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.693529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:02.693885 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.694389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.694931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.695934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:02.696558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.698235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:02.702099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:02.703405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:02.704371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 180/366] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:02.709834 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.713136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 187/367] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.714269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.825028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1923a1-a4f0-4ff1-88c7-58bc6f9c5ea0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.828618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ba865-13e2-4776-8e4d-311e758a9ef5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.847089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.866862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.868368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.868822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.868951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:02.869385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] PATH_INFO: `/v3/users/6495f7d8870945ec9e3e631c2bd3cb59` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.870063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:02.870431 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:02.870842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:02.871288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] RBAC: Authorizing `identity:get_user(user_id=6495f7d8870945ec9e3e631c2bd3cb59)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.872284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:02.873185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.874011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:02.875224 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 188/368] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/users/6495f7d8870945ec9e3e631c2bd3cb59 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.876198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.876547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 181/369] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:02.877453 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:02.963227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:02.984654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702906-b4b9-4366-925d-ebe883186458 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:02.991597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba74d9-ed9c-449b-b4c8-66207ca314e9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.020988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.021826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.022214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.022591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.023482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.026437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.028119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.031662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.032341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.032636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.032923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.039442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 189/370] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.040554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.102004 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.120682 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.122882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.157537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6deb9-308a-4729-8180-c9c461532d42 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.191872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.194383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.195295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.195689 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.196068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.197114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=caf820f64ea84c0e8813051c8a016284) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.197508 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.199158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.205811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 190/371] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.206772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.239393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 182/372] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:03.240948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.319346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c22ff-30df-418a-8d23-94f630c53a27 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.335286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.362494 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.363194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.363479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.363758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.364609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] RBAC: Adding query filter params (role.id=ecee8366dd6742319b3fc602ac113e8e, user.id=6495f7d8870945ec9e3e631c2bd3cb59, scope.system=all) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:03.364924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.366408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.380793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 191/373] 10.222.0.77 () {56 vars in 1308 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/role_assignments?user.id=6495f7d8870945ec9e3e631c2bd3cb59&scope.system=all&role.id=ecee8366dd6742319b3fc602ac113e8e => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.381666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.382867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17499790-0d3d-4346-acab-02e494d2a788 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.434068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.434856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.435136 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.435406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.468900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.545141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78df4c-ae74-412c-8387-4fe84847b533 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.552784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.555398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d9be8-7c09-4a19-a389-6a7cee88c22c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.604642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.605539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.605820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.606091 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.609593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.611078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e646693-53e1-45f8-952f-2762bdeac860 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.612843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 192/374] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.614074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620c04-1a2a-4525-a2da-3c7fb7af4ae6 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.614347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620c04-1a2a-4525-a2da-3c7fb7af4ae6 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.614616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10620c04-1a2a-4525-a2da-3c7fb7af4ae6 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.615876 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 193/375] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:03.619694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620c04-1a2a-4525-a2da-3c7fb7af4ae6 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.680100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.711975 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 183/376] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:03.713731 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.714247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.714760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.736345 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:03.738357 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:03.793146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10620c04-1a2a-4525-a2da-3c7fb7af4ae6 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:03.811126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:03.853310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:03.854186 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:03.854474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:03.854807 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:03.858818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 184/377] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:03.859692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.860742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:03.862185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:03.865929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 194/378] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:03.880623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:03.988868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cb5cd-25d1-44a7-b0dc-97ca4f7ae6a1 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.003497 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c856-4d2c-4047-b933-b6cecf6d8b3c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.012737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.025336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.026214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.026494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.026799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] PATH_INFO: `/v3/projects/302016200c584d9f8ebe7afab4995fd0` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.028010 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] RBAC: Authorizing `identity:get_project(project_id=302016200c584d9f8ebe7afab4995fd0)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.029505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.031556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 185/379] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/projects/302016200c584d9f8ebe7afab4995fd0 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.032333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.044065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.044874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.045151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.045424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.056573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:04.066285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:04.067453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 195/380] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:04.069442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.081810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.172423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac103-a53b-44d1-bdcf-78bd7f53bfb5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.217004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.217680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.217961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.218237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.220421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=caf820f64ea84c0e8813051c8a016284) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.220421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.221245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.228552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 186/381] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.234805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.247501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8bc5-bf01-43e7-94ae-634895604e55 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.312482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.314112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.314649 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.315361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] PATH_INFO: `/v3/groups/8414b1abe49d4ad1bf209b90913439c3` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.323395 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] RBAC: Authorizing `identity:get_group(group_id=8414b1abe49d4ad1bf209b90913439c3)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.325691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.328288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 196/382] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/groups/8414b1abe49d4ad1bf209b90913439c3 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.333814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.380234 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.462367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aade012-f693-4e9f-8f59-f51048886ed1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.473185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7f5c-98a7-47bd-a6ad-fb43fad52c81 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.483823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.516185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.517414 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.517902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.518394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.519536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] RBAC: Adding query filter params (group.id=8414b1abe49d4ad1bf209b90913439c3, role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=302016200c584d9f8ebe7afab4995fd0) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.520058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.521831 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.529855 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 197/383] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/role_assignments?group.id=8414b1abe49d4ad1bf209b90913439c3&scope.project.id=302016200c584d9f8ebe7afab4995fd0&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.557873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.559030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.559564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.560035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.561071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] RBAC: Adding query filter params (name=member) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:04.561582 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.563260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.581024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 187/384] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.586475 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.772744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:04.787603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacad48-c8de-4501-b3ec-214e5ed850ea None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:04.860342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:04.861160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:04.861439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:04.861715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:04.863044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:04.864499 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:04.866474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 198/385] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:04.872202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:04.989788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d6f98-3e68-497e-ab4b-c3e4dae7d95b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.028789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.029476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.029746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.030019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.031254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.032740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abdbcd-1f6f-4a95-9644-a7a7ec5a89e5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.034765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 188/386] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:04 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:05.040492 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.164188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94378db-b1f8-4261-9564-16316b98106b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.206962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.207878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.208169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.208432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/groups/cff057135ee3466db627fbc7229a077e/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.216413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, group_id=cff057135ee3466db627fbc7229a077e, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:05.217904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5ff64-a855-4fde-92cf-72e4e6b8deeb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:05.251663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 199/387] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:25:05 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/groups/cff057135ee3466db627fbc7229a077e/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:05.403477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b90c3-f9df-4ffc-bd36-120e45b6400b None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.404068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b90c3-f9df-4ffc-bd36-120e45b6400b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.404068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b90c3-f9df-4ffc-bd36-120e45b6400b None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.405755 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 189/388] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:05.411775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.412249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.412359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.436806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:05.437939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:05.463439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.528703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 200/389] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:05.568310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b90c3-f9df-4ffc-bd36-120e45b6400b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.622536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:05.704766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b90c3-f9df-4ffc-bd36-120e45b6400b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:05.752458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:05.753279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:05.753557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:05.753830 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:05.774320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:05.782407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:05.783469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:05.784421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 190/390] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:05.789633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:05.957791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e57dee-e16c-4b69-a39e-ee7c048f72af None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.004518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.005210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.005500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.005840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.006617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.006951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.008345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7711fc-52d7-486e-9102-6590839d0485 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.023194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 201/391] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.028968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.115077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd5b0-866a-4ade-b317-8aec4e6428aa None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.115769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd5b0-866a-4ade-b317-8aec4e6428aa None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.116286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd5b0-866a-4ade-b317-8aec4e6428aa None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.118306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 202/392] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:06.123817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.124405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.124906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.143999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:06.145583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:06.161075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.199450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.207681 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2012-f6ae-422d-b9ee-aa1e6d3fef6f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.245401 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.246733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.247280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.247769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.249285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.251131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.253344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 191/393] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.259529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.309816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 203/394] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:06.348228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.484819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd4289-4a82-4259-949a-5a92aeaddc27 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.525012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99625d8-6553-4e3c-946a-7c0497d7da65 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.537644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.538902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.539412 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.539926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.541426 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.543233 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.545637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 192/395] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.551358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.585607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.627422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.628279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.628524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.628804 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.659626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:06.664100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e7e90-fdf5-4707-a882-44a23a929d82 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:06.675517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:06.676595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:06.677524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 204/396] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:06.694443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:06.708671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:06.709949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.711175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.711668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.712337 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/groups/cff057135ee3466db627fbc7229a077e/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.715324 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a6dfbca1cb74971af50f3c580a922ea, group_id=cff057135ee3466db627fbc7229a077e, role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.717291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.733897 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 193/397] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:25:06 2022] PUT /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea/groups/cff057135ee3466db627fbc7229a077e/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:25:06.910262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86136-5f2c-42e7-8efc-b2d25fa272e9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:06.964551 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:06.965245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:06.965528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:06.965806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:06.966573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:06.966903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:06.968304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:06.983270 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 205/398] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:06.989429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.160890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.171977 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e165a80-34bc-420c-a99d-b38820e01a3e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.226364 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.227275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.227626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.227906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.229131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.230629 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95032868-fc04-4177-9638-1da444b369c2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.233334 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 194/399] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:06 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.238156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.372415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.409560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeac35-9563-4d71-9c66-ea3d6296d0e9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.413595 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f939-424e-4c89-b2b0-d9d5d12997d4 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.413821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f939-424e-4c89-b2b0-d9d5d12997d4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.414116 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f939-424e-4c89-b2b0-d9d5d12997d4 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.416675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 195/400] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:07.422302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.422847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.422988 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.450312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.451541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.452178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.452844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.454266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.456023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.458266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 206/401] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:07.461915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:07.461915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:07.465914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.592020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac6af-73ff-41ca-b314-27c93b1050c0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.621348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 196/402] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:07.634269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.635845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.636584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.637275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/groups/cff057135ee3466db627fbc7229a077e/roles/99b1f8fc21014350ba9f398b3774c26a` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.640200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, group_id=cff057135ee3466db627fbc7229a077e, role_id=99b1f8fc21014350ba9f398b3774c26a)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:07.641966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b8578-6bdd-46c2-a95f-c7ca5a13b8f2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:07.647025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.654104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.661906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 207/403] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:25:07 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/groups/cff057135ee3466db627fbc7229a077e/roles/99b1f8fc21014350ba9f398b3774c26a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:25:07.786087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64d7c-d499-4469-a483-2e5c88d73bba None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.786279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64d7c-d499-4469-a483-2e5c88d73bba None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.786562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64d7c-d499-4469-a483-2e5c88d73bba None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.789089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 208/404] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:07.796219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.796537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.796781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:07.817911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:07.819173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:07.910360 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 209/405] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 20:25:07.911054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:07.930277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69129c48-0241-4ef1-98f5-77f295e8a6f3 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:07.934655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:07.987209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:07.988038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:07.988316 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:07.988586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.004757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4ebaf3bf-bbd7-42ba-af41-ba85f2588b2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:08.015129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:08.016163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:08.017149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 197/406] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:08.018442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30338-61ac-4ff5-9375-1dcb47e985b8 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.018442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30338-61ac-4ff5-9375-1dcb47e985b8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.018630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd30338-61ac-4ff5-9375-1dcb47e985b8 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.025073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 198/407] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:08.025815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd30338-61ac-4ff5-9375-1dcb47e985b8 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.060997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb6927-8428-4633-ae04-956ef7fb594e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.106037 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.135427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.138165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.139644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.140168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.165579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-287dcda4-5fe8-467e-8c55-eb837289a549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:08.177672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:08.178782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:08.179722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:08.192464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 210/408] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:08.194226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.195848 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.197801 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.219302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd30338-61ac-4ff5-9375-1dcb47e985b8 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.231718 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:08.233344 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:08.283177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.283861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.284141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.284413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.285174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.285480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.288298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.300780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 199/409] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.300780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.326068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.347230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 211/410] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:08.348438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.434092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17173-a358-4a57-8cdb-423ed74e572e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.458488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7e3d-47cc-4ed2-85b5-5955d7de859e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.477924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.478506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.478819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.479094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.479848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.480152 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.481649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.482280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.493478 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 200/411] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.499415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.506707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.507657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.508024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.508368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.509771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.511886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.518770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 212/412] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.519901 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.594756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.626246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac840d8-5d7e-4fa0-acf0-85ad311fd3eb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.658325 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7a0b-d1e4-4250-9793-6119e86d15a2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.662353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.662852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.663198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.663541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.674315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:08.682173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:08.683513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 201/413] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:08.684481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.705286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.707010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.707299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.707574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] PATH_INFO: `/v3/groups/8414b1abe49d4ad1bf209b90913439c3` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.709535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] RBAC: Authorizing `identity:get_group(group_id=8414b1abe49d4ad1bf209b90913439c3)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.711030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.717296 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 213/414] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/groups/8414b1abe49d4ad1bf209b90913439c3 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.718240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.775254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.817281 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0eaad-52e1-4b54-9a88-7b41cbb5a2dc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.830010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c5157-a349-484e-b462-b6db09946f50 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:08.862171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.863693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.864267 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.864900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.866047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:08.866587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.866884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:08.867232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:08.867574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:08.868431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:08.868843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:08.869328 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.870312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:08.871438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 202/415] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.872556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:08.880871 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:08.881934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 214/416] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:08.887549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.000434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359699a-d132-4368-a813-91c174a81e9e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.009045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61238-92a7-4686-a38e-8f345da8308d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.026390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.040713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.041959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.042448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.043003 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] PATH_INFO: `/v3/projects/302016200c584d9f8ebe7afab4995fd0` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.044615 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] RBAC: Authorizing `identity:get_project(project_id=302016200c584d9f8ebe7afab4995fd0)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.046605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.048784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 203/417] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:08 2022] GET /identity/v3/projects/302016200c584d9f8ebe7afab4995fd0 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:09.053456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.053456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.053456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.053763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284/groups/cff057135ee3466db627fbc7229a077e/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.054869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.055993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=caf820f64ea84c0e8813051c8a016284, group_id=cff057135ee3466db627fbc7229a077e, role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.057443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.086937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 215/418] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:25:08 2022] PUT /identity/v3/projects/caf820f64ea84c0e8813051c8a016284/groups/cff057135ee3466db627fbc7229a077e/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:09.088299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.150216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.190788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e246ae-e3a5-40ea-bc25-58cf8b37ad8a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.232603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.233651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.234329 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.234796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.318723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.320273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.333924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fea95-44ab-42a9-be02-53b149d6dce9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.382097 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.383028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.383356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.383576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] PATH_INFO: `/v3/projects/302016200c584d9f8ebe7afab4995fd0/groups/8414b1abe49d4ad1bf209b90913439c3/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.385597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=302016200c584d9f8ebe7afab4995fd0, group_id=8414b1abe49d4ad1bf209b90913439c3, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.387126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60fa6f-6198-4358-b860-5459a38570b6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.401611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.410940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 216/419] 10.222.0.77 () {58 vars in 1442 bytes} [Thu May 19 20:25:09 2022] PUT /identity/v3/projects/302016200c584d9f8ebe7afab4995fd0/groups/8414b1abe49d4ad1bf209b90913439c3/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:09.412208 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d258-1cce-489d-bdb5-e0a6204c1726 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.412507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d258-1cce-489d-bdb5-e0a6204c1726 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.412793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d258-1cce-489d-bdb5-e0a6204c1726 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.414227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 217/420] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:09.420410 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.420783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.420975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.440543 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:09.441787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:09.452735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 204/421] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:09.460624 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.477077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.536668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 218/422] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:09.589558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.616239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf040-37fe-4889-80e0-ea94521563ea None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.658907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.659752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.659989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.660278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.662739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.663071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.665086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 205/423] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:09.670941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.718779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:09.791579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2ca62-9266-4365-9e94-32671486ee21 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.829852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8733c-d2e3-4b8d-9e6c-f9f9ba2f1bd9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:09.861788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.862625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.862959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.863235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.875045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:09.883920 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:09.885018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:09.886002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 219/424] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:09.893015 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:09.894094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:09.894475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:09.897770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:09.898513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.899879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:09.902297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:09.910019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 206/425] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:09.911251 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:09.953632 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.080314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988298-3b5a-4c65-a68c-79d396678741 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.088671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ec4a5-0114-4b88-8bd8-ce4dea7ae805 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.097949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.137586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.138284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.138649 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.138980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.139980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.140299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.141816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548c61f-aa86-4894-bc69-39182eabd5c5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.142319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.143315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.143761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.144304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.145167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.145482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.146962 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.152780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 220/426] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:10.153695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 207/427] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:09 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.154724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589bcf9-e6a9-4e73-be1d-869d2b8a5ff0 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.155191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589bcf9-e6a9-4e73-be1d-869d2b8a5ff0 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.155621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589bcf9-e6a9-4e73-be1d-869d2b8a5ff0 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.157060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 221/428] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:10.161330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.163003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.163485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.163919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.185114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:10.186871 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:10.340794 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 222/429] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:10.358313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7d94d-da35-420d-afa3-9c5ebfbdc9a1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.380705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.401805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.404487 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.406159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.406800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.407161 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.469910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.507969 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.509618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.530079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fd93-10f0-4af8-8344-6e1c2e23aad1 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.577918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.579226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.579519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.579799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.593400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:10.603931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:10.604979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 20:25:10.605893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:10.610729 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 223/430] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:10.612263 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.657654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 208/431] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:10.663290 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.717855 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.751348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:10.752766 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d37118-55a2-4093-9e7c-fa54d1eb4347 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.792855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee45e-e505-4c5c-ab34-54866bc9ccdd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.798657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.799377 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.799665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.799944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.800713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:10.801023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.802944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.814981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 224/432] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:10.822253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.845325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:10.846319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:10.846599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:10.846999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] PATH_INFO: `/v3/projects/6a6dfbca1cb74971af50f3c580a922ea` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:10.848353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] RBAC: Authorizing `identity:get_project(project_id=6a6dfbca1cb74971af50f3c580a922ea)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:10.849976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:10.852199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 209/433] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/projects/6a6dfbca1cb74971af50f3c580a922ea => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:10.857908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:10.955315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc921f-cc21-4472-9dae-7b63c37209b7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:10.985454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088064e-1a40-4e67-951f-a97cece3eb27 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.003857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.004445 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.004970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.005264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.011166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.029966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.030967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.031252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.031525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.032900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.034379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.036653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 210/434] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:11.042649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.053035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.098012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.100028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.169832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b9aa1-3d97-4adc-a5b6-254d735b5e6f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.214387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.215534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.215821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.216366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.217232 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=6a6dfbca1cb74971af50f3c580a922ea) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.217716 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.220122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.228897 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 211/435] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=6a6dfbca1cb74971af50f3c580a922ea&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:11.239603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 225/436] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:25:11.245551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.336527 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.372458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22b15b-a919-4cd7-83e1-98d816b0a22e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.410482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.411405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.411692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.411973 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.413219 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.414728 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.416936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 212/437] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.422264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.463499 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.543254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90376b5e-a9dd-45bd-aaec-f82da1aeabc7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.579621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.580416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.580760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.581040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.582227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.583717 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc46c-d981-4f2a-8fa5-da0822ed791f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.585725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 226/438] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.591630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.695973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ca13-0bc8-46ed-8e3b-9b1a4d581871 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.696817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ca13-0bc8-46ed-8e3b-9b1a4d581871 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.697312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5ca13-0bc8-46ed-8e3b-9b1a4d581871 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.700243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 227/439] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:11.706021 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e320-af2b-4940-9adc-1b040faec33e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.706021 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e320-af2b-4940-9adc-1b040faec33e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.706244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e320-af2b-4940-9adc-1b040faec33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.707831 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c765f5d-9ffb-42fe-b445-1e103d045383 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.731228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-ced0e320-af2b-4940-9adc-1b040faec33e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:11.732439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-ced0e320-af2b-4940-9adc-1b040faec33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:11.748111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.748782 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.749059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.749333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:11.750268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=99b1f8fc21014350ba9f398b3774c26a, scope.project.id=caf820f64ea84c0e8813051c8a016284) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:11.750490 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:11.752022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:11.757985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 213/440] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=99b1f8fc21014350ba9f398b3774c26a => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:11.808417 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 228/441] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:11.832508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:11.835982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:11.950192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a605a4-45f0-42f7-8318-3b9ead7aeaca None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:11.988284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:11.989113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:11.989396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:11.989675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.001925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:12.010378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:12.011447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:12.012385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 214/442] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:12.017840 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.018512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254756f3-8f8f-4aa4-b268-37dfd782d1e3 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.018836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254756f3-8f8f-4aa4-b268-37dfd782d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.019125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254756f3-8f8f-4aa4-b268-37dfd782d1e3 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.020522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 229/443] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:12.025947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.026237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.026518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.045527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:12.046788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:12.076703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.086029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.131952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 230/444] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:12.133370 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4479c-f30b-4300-a73c-c7b0a754358e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.153385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.176492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.177187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.177473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.177753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.178524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:12.178868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.180309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.190576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 215/445] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:12.195997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.263442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07248596-d3ff-4c15-a2d6-551018c7327d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.294242 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e5a95-28e3-4cbd-a5aa-95ddf892852e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.297351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.298159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.298441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.298766 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.309328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:12.316923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:12.317046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:12.318043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:12.318991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 231/446] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:12.326925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.331959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.332621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.332905 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.333183 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.353644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.402208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.403767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.429044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49adc-885c-4cb6-af49-38edbb9b6e8e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.463821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.464502 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.464791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.465102 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.465859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:12.466169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.467591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.476254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 232/447] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:12.482236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.502331 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 216/448] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:25:12.507872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.531025 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.571585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.586962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017775-9929-4c1c-bd89-17c11bd17731 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.608160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f2d6e-3591-4193-a846-c9b6acc1daba None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.620085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.620742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.621023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.621301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.643557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.644426 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.644709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.644983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] PATH_INFO: `/v3/projects/caf820f64ea84c0e8813051c8a016284` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.646194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] RBAC: Authorizing `identity:get_project(project_id=caf820f64ea84c0e8813051c8a016284)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.647730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.649625 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 217/449] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/projects/caf820f64ea84c0e8813051c8a016284 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:12.655171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.688812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.690405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.746060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.755456 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b543d5-f136-4568-9378-73b43d73862d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.774847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:12.790027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.790821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 233/450] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:25:12.790957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.791179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.791457 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] PATH_INFO: `/v3/groups/cff057135ee3466db627fbc7229a077e` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.792655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] RBAC: Authorizing `identity:get_group(group_id=cff057135ee3466db627fbc7229a077e)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.794192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.795865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 218/451] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/groups/cff057135ee3466db627fbc7229a077e => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:12.796751 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.801425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:12.902564 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f2078-b0e5-492b-b687-2162b951770c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.903201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce40f1-e90d-49d3-8259-419cc6a4f415 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:12.935682 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.936025 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:12.936554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.936680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:12.936836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.936934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:12.937110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] PATH_INFO: `/v3/projects/302016200c584d9f8ebe7afab4995fd0` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.937220 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:12.938025 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] RBAC: Adding query filter params (group.id=cff057135ee3466db627fbc7229a077e, role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=caf820f64ea84c0e8813051c8a016284) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:12.938322 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] RBAC: Authorizing `identity:get_project(project_id=302016200c584d9f8ebe7afab4995fd0)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.938418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:12.939808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.939933 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:12.941535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 234/452] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/projects/302016200c584d9f8ebe7afab4995fd0 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:12.954807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 219/453] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/role_assignments?group.id=cff057135ee3466db627fbc7229a077e&scope.project.id=caf820f64ea84c0e8813051c8a016284&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:12.955082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:13.009398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:13.059518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8537a-edfb-4d87-8a21-f3ac9bbed999 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:13.098051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:13.098958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.099237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.099510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] PATH_INFO: `/v3/groups/8414b1abe49d4ad1bf209b90913439c3` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.100780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] RBAC: Authorizing `identity:get_group(group_id=8414b1abe49d4ad1bf209b90913439c3)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:13.102245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33318430-3072-4663-9912-0bc17ce65f8c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:13.104017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 235/454] 10.222.0.77 () {56 vars in 1180 bytes} [Thu May 19 20:25:12 2022] GET /identity/v3/groups/8414b1abe49d4ad1bf209b90913439c3 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:13.110221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:13.137959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:13.216721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e67494-3143-4003-9cb9-a4659fc57256 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:13.251133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:13.251799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:13.252081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:13.252356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:13.253201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] RBAC: Adding query filter params (group.id=8414b1abe49d4ad1bf209b90913439c3, role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=302016200c584d9f8ebe7afab4995fd0) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:13.253508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:13.255048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98e8c-4d39-4176-9c11-2351a9097954 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:13.261151 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 220/455] 10.222.0.77 () {56 vars in 1376 bytes} [Thu May 19 20:25:13 2022] GET /identity/v3/role_assignments?group.id=8414b1abe49d4ad1bf209b90913439c3&scope.project.id=302016200c584d9f8ebe7afab4995fd0&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.000340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4641f-8012-489b-80ec-4a601ec2e8e1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.001501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4641f-8012-489b-80ec-4a601ec2e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.002214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4641f-8012-489b-80ec-4a601ec2e8e1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.005323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 236/456] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:16.014275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.014922 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.015416 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.038716 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:16.039924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:16.056887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addacf4-bf6f-4c29-8e35-5affec97be3d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.057510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addacf4-bf6f-4c29-8e35-5affec97be3d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.057980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addacf4-bf6f-4c29-8e35-5affec97be3d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.061349 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 237/457] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:16.066280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6fb-4551-4fe8-a188-c1ad81bd5319 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.066889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6fb-4551-4fe8-a188-c1ad81bd5319 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.067346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6fb-4551-4fe8-a188-c1ad81bd5319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.099658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-d699c6fb-4551-4fe8-a188-c1ad81bd5319 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:16.100868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-d699c6fb-4551-4fe8-a188-c1ad81bd5319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:16.169572 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 221/458] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:16.193276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.227141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.261809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 238/459] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:16.265095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be64b-a804-4e85-b8d6-77edfc4a2394 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.265593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be64b-a804-4e85-b8d6-77edfc4a2394 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.266040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be64b-a804-4e85-b8d6-77edfc4a2394 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.267887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 239/460] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:16.273031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.273495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.273956 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.303065 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:16.304611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:16.323767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519177a3-027e-4722-bf26-a01c4ee16818 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.359725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.360832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.361299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.361736 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.372672 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.374406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.379075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.387281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 240/461] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:16.388314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:16.395315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.396484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.397549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:16.397549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:16.397549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.397549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:16.399663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 222/462] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:16.407683 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.481977 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.514109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fc354-cfc2-4d70-9c63-3d081f76aa3c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.518597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb6301-2f32-436b-bb01-70314f4946af None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.549497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.550529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.551069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.551551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.552515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.553125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.554882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.556282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.557308 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.557659 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.558061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.567932 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 223/463] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.569056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.569173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.570539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:16.590667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.591743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.592715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:16.592715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:16.592715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.592715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:16.592715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 241/464] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.593036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.631082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.674542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888bc90-d8b2-4fe7-9100-07b5f195c047 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.706439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.708926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a750-b42a-43ff-9d40-ec80a29e77ec None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.714440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.715578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.715961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.716339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.729286 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.731030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:16.749603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:16.751002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:16.752254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:16.752254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:16.752254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:16.752254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:16.758292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 224/465] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:16.758292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.758839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.759882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.760384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.760846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.761782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.763538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.788423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 242/466] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:16 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:16.789683 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:16.863473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323769d-1ccd-4e2f-b6a5-85be86d59546 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.901489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:16.902378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.902831 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.903283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.904434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:16.904797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:16.906386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c515d-a4ce-4e3a-a2ce-1ae7b1e74435 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:16.921471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 225/467] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:16.922900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee5d-afb5-416f-a27f-ef8310a1afdd None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.923192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee5d-afb5-416f-a27f-ef8310a1afdd None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.923486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee5d-afb5-416f-a27f-ef8310a1afdd None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.925007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 226/468] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:16.931605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:16.931891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:16.932452 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:16.950675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:16.951867 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:16.952769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:16.965819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82201d-9b95-4deb-b58f-9ef914e28dd0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:16.994409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.007863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.009262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.009732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.010238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.011317 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.011791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.013493 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.033038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 243/469] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:17.034450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.039407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 227/470] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:17.040445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.154279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdccfdb-878f-4bd2-919e-6cf7cfaca378 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.171172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1867d-e3a6-4dd4-b991-8fc95429cfdc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.192906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.194009 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.194454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.194912 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.195815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.197773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.208930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.209833 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.210069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.210449 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.211287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.212880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273f968-ad3b-4d5e-807a-1abc19819cb7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.222126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 244/471] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:17 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:17.223501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.235356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.266217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 228/472] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:17 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:17.389766 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a543-7b15-4096-b39f-58c2e5a7fe4c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.442930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555013f4-0bce-4727-a2ce-4b6ad0d4d5f3 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.443271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555013f4-0bce-4727-a2ce-4b6ad0d4d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.443494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555013f4-0bce-4727-a2ce-4b6ad0d4d5f3 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.445149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 229/473] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:17.451106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.451531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.451817 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.454546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.455661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.456160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.456641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.470601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.472612 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.473581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:17.474896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:17.492441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:17.493532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:17.494605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:17.494605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:17.494605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:17.494605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:17.497103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 245/474] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:17.505701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.512868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.572889 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 230/475] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:17.585563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.600672 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.642225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3a1a-e298-4e75-bd07-bd3248580c31 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.694854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.695549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.695850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.696290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.697969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:17.698291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.699781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.715916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 246/476] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:17.722306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.734752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee31de-9f92-4452-aea9-e409cca3d217 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.779447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.780151 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.780434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.780710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.781489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.782975 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.793781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.sql.core [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:25:17.793781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:25:17.793781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [parameters: {'id': 'bf31cc2699ef47dfa6b482000c607ac6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:25:17.793781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270826) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result.read() May 19 20:25:17.812597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return ref.to_dict() May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:17.813698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application yield resource May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application next(self.gen) May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise self.value May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application session.commit() May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:25:17.814924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.session.flush() May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application compat.raise_( May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:25:17.816041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:25:17.817106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application conn.query(q) May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result.read() May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:25:17.818080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [parameters: {'id': 'bf31cc2699ef47dfa6b482000c607ac6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:17.822786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 20:25:17.824908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:17.831211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 231/477] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:25:17 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:17.831211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:17.848209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3061c77-7e77-422c-af15-9d19da5606c1 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.852198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.871533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:17.891631 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.892415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.892760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.893039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.893756 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:17.895509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:17.918996 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 247/478] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:17 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:17.946529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4630-bbc8-4f33-8626-296d029d8602 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:17.984963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:17.985803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:17.986092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:17.986372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:17.998906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-7d8aa250-bf5b-41e2-8bfb-7a7b884b5aff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:18.007602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:18.010114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 20:25:18.012218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:18.018704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 232/479] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:18.018927 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:18.144210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea89b-aff5-465b-9b8b-0ada42834a82 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:18.199895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:18.200657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:18.200955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:18.201276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:18.202055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:18.202404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:18.203786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7e4d9-b206-451b-8dba-c9fc9a770f53 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:18.218625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 248/480] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:19.526263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a48b2-1da1-4b64-8a64-650cc6644c96 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.527049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a48b2-1da1-4b64-8a64-650cc6644c96 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.527049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a48b2-1da1-4b64-8a64-650cc6644c96 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.528499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 233/481] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:19.533660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.534172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.534338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.559654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:19.560854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:19.600219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.656465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 249/482] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:19.696209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a48b2-1da1-4b64-8a64-650cc6644c96 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:19.796883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:19.819903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a48b2-1da1-4b64-8a64-650cc6644c96 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:19.872788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:19.873552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:19.873835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:19.874112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:19.886645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:19.895088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:19.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:19.897068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 234/483] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:19.902671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.033917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c986d-fa3f-412e-94e5-d96726d64dcc None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.074271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.074979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.075257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.075529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.076399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:20.076705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.078094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20658c62-4f13-4816-acec-05deb03103e2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.086823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 250/484] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:20.093464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.163099 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d863aa-c69b-466e-89bc-a21bfc02e0c2 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.163454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d863aa-c69b-466e-89bc-a21bfc02e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.163646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d863aa-c69b-466e-89bc-a21bfc02e0c2 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.165369 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 251/485] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:20.170584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.170904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.171188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.211864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:20.213102 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:20.230800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30322211-e641-49ff-81e7-bc4a1bac507c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.258827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.299525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.300370 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.300658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.300941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.315272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 252/486] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:20.321923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.327619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.334970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:20.353434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:20.354515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:20.355579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:20.355579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:20.355579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:20.355579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:20.355579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 235/487] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:20.360399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.362412 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.538612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26edc5-bca9-445f-b66b-99d9689756ee None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.568120 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dfe9-fff7-464d-a595-296de5a91eab None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.591784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.592606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.592898 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.593179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.612768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:20.627469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:20.628579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:20.629541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 236/488] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:20.635753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.639269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.640258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.640546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.641793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.642569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:20.642911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.644374 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3172cd4-775e-4b00-a97c-750820279f0b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.665068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 253/489] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:20.666905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235fca5-37ea-41a7-8ad4-dbc68b97f28d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.667210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235fca5-37ea-41a7-8ad4-dbc68b97f28d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.667490 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235fca5-37ea-41a7-8ad4-dbc68b97f28d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.669879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 254/490] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:20.670608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235fca5-37ea-41a7-8ad4-dbc68b97f28d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.695112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.711091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.768396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1b8d-9eda-495f-ab08-be5f4b8ae8dc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.808197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.809355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.809864 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.810307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.811307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:20.811829 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.813557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf76f97-80ca-4785-b573-6da169e882d8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.816473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235fca5-37ea-41a7-8ad4-dbc68b97f28d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:20.823744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 237/491] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:20.825351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.825846 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.826422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.845565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:20.847132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:20.853951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:20.854898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:20.855188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:20.855470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:20.864043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:20.865550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:20.882196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:20.883435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:20.884598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 255/492] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:20.885388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.929458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 238/493] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:20.930770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:20.981192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:20.986858 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.009463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b3a68-a762-442a-8871-096c2e123e5b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.037632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d21f-a826-4f49-ba23-1ab10a805992 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.042896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.043716 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.044006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.044283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.054953 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.056479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.072578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.073198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.073478 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-2d519f91-005c-409b-8ae7-e440d379a589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:21.073666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.074928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.075949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:21.075949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:21.075949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.075949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:21.076212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.076212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:21.076363 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 256/494] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.076465 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.076542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247aef5-73bf-493e-922e-803ecbcd47d8 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.076542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247aef5-73bf-493e-922e-803ecbcd47d8 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.076686 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75397ae7-747b-40da-9544-83bf683d3520 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.077130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247aef5-73bf-493e-922e-803ecbcd47d8 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.078559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 257/495] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:21.083310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247aef5-73bf-493e-922e-803ecbcd47d8 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.113961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 239/496] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:21.115395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ce90-91e2-4717-bfd9-339e01e3abdf None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.115695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ce90-91e2-4717-bfd9-339e01e3abdf None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.115978 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28ce90-91e2-4717-bfd9-339e01e3abdf None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.118892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 240/497] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:21.118892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ce90-91e2-4717-bfd9-339e01e3abdf None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.196716 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247aef5-73bf-493e-922e-803ecbcd47d8 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.225448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.227086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28ce90-91e2-4717-bfd9-339e01e3abdf None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.229901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.232301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.233175 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.233568 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.233883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.246108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9fc7652f-3c6b-43ba-9e55-9ee65486e0fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:21.254637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.255792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:21.256725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 258/498] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.257488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae55a8-e1a3-49b6-a494-50ba0a6815b7 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.257488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae55a8-e1a3-49b6-a494-50ba0a6815b7 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.257711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae55a8-e1a3-49b6-a494-50ba0a6815b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.274092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.274872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.275148 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.275418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.275559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-caae55a8-e1a3-49b6-a494-50ba0a6815b7 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:21.276283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:21.276589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.276730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-caae55a8-e1a3-49b6-a494-50ba0a6815b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:21.278000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.290503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 241/499] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:21.291351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.353047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 259/500] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:21.354370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.354656 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.354962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.383524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:21.384720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:21.398002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9036951-8dc5-459a-8ced-606fe4e63953 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.431393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.433077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.433077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.433077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.453585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 260/501] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:21.455061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.476886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.506037 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.516788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.518320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.556490 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306836c-b31e-4a6c-8977-af3b4b1ba6d9 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.590203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.590878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.591093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.591373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.592125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:21.592435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.593812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.602179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 261/502] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:21.602992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.617548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 242/503] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:21.618389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.683336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.704520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff83003-e79a-4cc8-9465-69d39108b871 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.717336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.723907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281b2ae-9594-4685-95f0-8d9e9898ede5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.739040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.739845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.740130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.740403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.748197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.749644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.757428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.758226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.758511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.758820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:21.763657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.764714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 262/504] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.765789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.773354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.774888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:21.793957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.795198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 243/505] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.796190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.872254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d627-4f43-4de0-93ce-d41da5e565c0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.896124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934d3e8-013c-4d3e-8eaa-0ccee3dbd078 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:21.907961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.908870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.909141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.909416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.913244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.920321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:21.928134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.929156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 263/506] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.930531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:21.936295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:21.937128 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:21.937596 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:21.937875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:21.948708 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:21.950200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:21.966604 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:21.968084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:21.969750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 244/507] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:21.970785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.035915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9deae-fe7c-4241-8880-fdc4b262302d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.067832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7be587-fee0-4d6d-843c-ca44715ddc5e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.071260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.072059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.072343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.072652 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.083648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.085113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.102024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:22.102550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.103549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.104574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:22.104574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:22.104574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.104574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:22.104815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.104815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.104815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.105051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 264/508] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.105135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.105135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.105285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.105922 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.123738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 245/509] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.124816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.152890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.197429 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.214009 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e464de-b774-4ff5-9c29-64f8b627d823 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.226807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345797-9b9a-4030-a1f6-90453ed5d625 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.251457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.252132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.252412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.252668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.253400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.253712 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.255134 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.261237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.262302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.262302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.262528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.263237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.263543 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.264972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.271677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 265/510] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.271677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.283387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 246/511] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.283387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.368761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.373100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dbf2-93e2-47da-8a62-56fbcb5123ac None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.381377 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc9720-f726-44ab-95a3-b520ef3bb33a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.408376 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.409043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.409326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.409603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.410338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.410648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.412074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.414912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.415578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.415861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.416160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.416923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:22.417232 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.418639 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.423353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 266/512] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.424142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.427464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.432246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 247/513] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:22.432986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.533988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4c423-2253-4e4b-861e-4c152a102ecd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.538805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c5dfd-4676-4aae-99d8-3bd272535882 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.568505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.569137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.569418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.569697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.573427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.574104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.574384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.574658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.575400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.576884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.598057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 248/514] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:22 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:22.598639 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.602785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.662676 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.664849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.669132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.722807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bef6f-6b2f-46f7-8391-53661686b1fc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.760615 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.761447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.761730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.762007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.774178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.775859 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.782216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 267/515] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:22.787832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:22.795082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.796083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 249/516] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.797072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.874064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.913966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c986-26e9-448b-9af7-352558031e48 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.917325 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:22.921416 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208e43-8f8f-44a5-b451-c6801be3bc5e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:22.952942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.953747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.954035 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.954314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.957567 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:22.958373 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:22.958658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:22.959015 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:22.961817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.963397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.966552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:22.968242 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:22.978364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.979527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:22.980993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:22.984369 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 268/517] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:22.984501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:22.985429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:22.987285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:22.988714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:22.988882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 250/518] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:22.988882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.089090 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227291e3-da86-481b-8053-f4cd29812076 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.095167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad9ef5-3561-4d2b-8467-cacd7066c0c4 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.106868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.126646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.127340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.127631 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.127903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.128633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.129000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.130355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.132189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.133450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.133736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.134015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.142551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 251/519] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.144201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.145121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.146782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:23.166748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.167780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 269/520] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.173832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.190518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.261886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7cce6c-f0f1-4adf-98a8-33182f2eb60a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.283279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b8039-32e6-4c0c-a938-d40044c728fe None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.298330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.299369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.299658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.300111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.301262 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.301582 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.303368 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.321986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.322714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.323021 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.323299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.328776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.328925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 252/521] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.329029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.329122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.329230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.353739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 270/522] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.353739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.373248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.434629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.444092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9993-ceeb-469f-8a5d-c4664f03c0de None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.461497 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5683921-d2a3-4131-bf35-5c4c262f9955 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.479835 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.480931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.481211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.481486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.489888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.491405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.501513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.502190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.502501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.502785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.503539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.503851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.505240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:23.510275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:23.511347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 253/523] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:23.513023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.527163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 271/524] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.527163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.614287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.621598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59a356-ce3a-414c-aa74-734e86102037 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.639396 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18673-7078-4cb9-8187-46c4b57d745e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.657341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.657994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.658273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.658548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.674413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.675160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.675438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.675665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.676590 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=2abc2e4d2a924c5795ff69cd3a08ea0a) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.676827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.678254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.681609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.685013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 272/525] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/role_assignments?user.id=2abc2e4d2a924c5795ff69cd3a08ea0a&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.685762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.760973 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.762849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.812682 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39b25-20fa-4701-aa94-4e457a37fa80 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:23.851727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:23.852423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:23.852703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:23.852977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:23.853916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:23.854227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:23.855725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:23.890856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:23.901283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 254/526] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:23.903706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 273/527] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:23.904627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.907707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:23.979772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.034427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38850b-1c05-4ff0-894e-a0281c253735 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.037828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb238af7-5541-4fc7-a01f-9e2b04acce05 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.076300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.077301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.077588 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.077862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.081495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.082542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.083100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.083578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.089943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.091451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.093011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.095670 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:24.111112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.112098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.113093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:24.113589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.114485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 274/528] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:24.115512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.119562 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 255/529] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:24.125980 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.202253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.247059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3959-0e2c-4c9c-a021-26de98d828ea None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.260783 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.269844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e0c5c-7130-409c-a748-7c33868ebf10 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.293354 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.294026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.294311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.294589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.313986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.315226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.316196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.316695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.317885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.318459 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.320757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.340189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 256/530] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.340189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.387153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.389209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.443607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54c25e-e345-4987-9178-0fb59e08891a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.458458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.480096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.480880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.481261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.481605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.482474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.482910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.484453 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.508614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 257/531] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.508614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.509941 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 275/532] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:24.511126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.524218 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.609556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07b32-a6bd-4844-b9d4-6b909c4499bf None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.622542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeee96-9ac9-4bee-b215-de517189313b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.646427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.647376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.647760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.648107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.655028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.656611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.661498 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.662401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.662994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.663462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.664487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.664995 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.666753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:24.671654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.672620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:24.673620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 258/533] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:24.674161 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.683116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 276/534] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:24.688528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.711957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.787126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64c8b-a349-4498-addc-5d6adb922154 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.815911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:24.826522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.827301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.827589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.827886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.840448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.841985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.849886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818fa80-f3d2-45e0-bcd4-9b86efb1371f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:24.861081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:24.862194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:24.863244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:24.863244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:24.863244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:24.863244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:24.863244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 259/535] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:24.867812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.893177 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:24.894471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:24.895062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:24.895597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:24.896629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:24.897153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:24.898945 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:24.913077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 277/536] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:24.918835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:24.982444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.000341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0512fb-8118-44b2-ae5d-abb10f198d6c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.031619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07475c02-53c4-40eb-a4c4-7161542e3053 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.038122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.038788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.039076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.039358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.040101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.040408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.041881 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b37e9-2756-4b34-aac4-e526678b69ef None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.059788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 260/537] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:25.061241 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb8-7a48-4b00-9f12-8f37fbde72d9 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.061537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb8-7a48-4b00-9f12-8f37fbde72d9 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.061821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879beb8-7a48-4b00-9f12-8f37fbde72d9 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.063171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 261/538] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:25.063856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879beb8-7a48-4b00-9f12-8f37fbde72d9 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.070093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.070957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.072392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.072747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.073670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=7d09b1140a9d4cad95e85b6a094e4865) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.074053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.075604 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa32f-fd65-4f3b-a2e3-619dc26ed40d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.079583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.083522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 278/539] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:24 2022] GET /identity/v3/role_assignments?user.id=7d09b1140a9d4cad95e85b6a094e4865&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:25.085202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.085494 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.085775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.105602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:25.106891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:25.186625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 279/540] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:25.220798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.322777 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879beb8-7a48-4b00-9f12-8f37fbde72d9 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.377870 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.378403 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.378708 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.378981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.386537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.388443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.391386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284e74-7cf0-4e6d-94de-e145901546a8 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:25.404236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:25.405462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:25.406703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:25.408878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 262/541] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:25.411706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.425842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.427986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.442508 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.443604 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.444047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.444480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.471623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:25.487581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:25.488872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:25.490046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 280/542] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:25.497521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.576997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da9fc4-96fa-4364-9c45-1e22ad5dd957 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.635983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c37ab-9543-4699-aeda-0119e4b66dd3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.662839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.663683 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.663815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.664068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.664878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.665226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.674757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.686365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.687738 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.688180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.688636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.689561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.690032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.691637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.700637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 263/543] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:25.701693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 281/544] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:25.706500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.707489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:25.761311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.815338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff6e75-3e6d-4b17-9fae-2768b0e760d8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.827165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:25.855417 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.856561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.857040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.857535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.873673 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666f3d4-90ac-4ec3-9611-65cdfc5ce397 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:25.883929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.885779 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.911560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e90036-96ba-4178-8218-19620711d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:25.912238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90036-96ba-4178-8218-19620711d130 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:25.912525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90036-96ba-4178-8218-19620711d130 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:25.912801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e90036-96ba-4178-8218-19620711d130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:25.913668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90036-96ba-4178-8218-19620711d130 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=ecfc0c1a9b56419fbe33fc10047075b8) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:25.913984 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90036-96ba-4178-8218-19620711d130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:25.916283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e90036-96ba-4178-8218-19620711d130 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:25.926715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 264/545] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/role_assignments?user.id=ecfc0c1a9b56419fbe33fc10047075b8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:25.928549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:25.929520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:25.930535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:25.930535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:25.930535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:25.930535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:25.930535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 282/546] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:25.940848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e90036-96ba-4178-8218-19620711d130 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.057375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e90036-96ba-4178-8218-19620711d130 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.089303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.099608 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.100411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.100853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.101039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.101765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:26.102573 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.104263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c253a-8a57-4c5d-8024-b55a876e4aae None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.123606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 265/547] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:26.129032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.240890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ba542-6092-4fba-91a0-8d375703ede7 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.241236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ba542-6092-4fba-91a0-8d375703ede7 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.241438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ba542-6092-4fba-91a0-8d375703ede7 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.243092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 266/548] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:26.248257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.248543 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.248820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.265659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:26.266888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:26.281432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20734a33-4779-46b3-9813-ce9004dd687a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.290031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.338555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 267/549] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:26.369029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.375405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.376228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.376513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.376792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.393824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.395323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:26.427242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:26.428633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:26.429809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 283/550] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:26.437425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.473109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8afb1-8d8c-4618-9b29-151f17c30107 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.499961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.524291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.525098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.525406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.525720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.546717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:26.554520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:26.555626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:26.556589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:26.564637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 268/551] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:26.571868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.607018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621e7b-978a-493e-8dda-fa0b87789493 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.677044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.677730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.678015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.678295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.679183 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:26.679496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.680959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.721990 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 284/552] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:26.728153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.745844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53039086-0800-40ae-961a-8a7b928538ec None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.768427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.807303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.807985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.808269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.808542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:26.809313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:26.809619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:26.811077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:26.829670 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 269/553] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:26.838189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:26.917725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:26.925108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0d8d-46f1-498c-8930-38d606fa13fc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:26.991984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:26.992562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:26.992899 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:26.993176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.024587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cba5e4-3390-46d3-8af7-e31ca393cec8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.084930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.086217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.086754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.087260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.104956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.107147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.122051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.123571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:27.137878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.138989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.139995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:27.139995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:27.139995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.139995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:27.139995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 270/554] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:27.144878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.182085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.251750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.258964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f544b-3b79-4180-bd35-0bfd4aa5666d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.305545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.306224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.306516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.306890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.307645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.307959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.309385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.329413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 271/555] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:27.335890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.348862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 285/556] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:25:27.354746 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.460541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460b1e-f224-47dc-8c19-5738cc957b8e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.466596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb88cdd-1edb-4902-b516-cf7b1c111593 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.489619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.506911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.508020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.508474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.508951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] PATH_INFO: `/v3/users/glance` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.510937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.512305 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.512839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.513948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.518773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.520260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.526827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.528901 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-8367e329-a061-4500-9fc8-6c46256bbe82 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:27.537628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.538875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:27.539950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:27.542763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 272/557] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:27.544704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7ddd-472a-461a-8eb6-d2e18e26ba8c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.545200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7ddd-472a-461a-8eb6-d2e18e26ba8c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.545696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7ddd-472a-461a-8eb6-d2e18e26ba8c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.548035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 273/558] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:27.549108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce7ddd-472a-461a-8eb6-d2e18e26ba8c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-0c341b11-ea39-4b94-86fe-a6072f071b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:27.561100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.562182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.563307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:27.563307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:27.563307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:27.563307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:27.565743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 286/559] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:27.566298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.567512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.568028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.568521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.589819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:27.592017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:27.662867 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce7ddd-472a-461a-8eb6-d2e18e26ba8c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.684247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 287/560] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:27.684247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.716763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.718075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.718817 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.719621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.721395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.721917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.724569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.756375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 274/561] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:27.756375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.809367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1bec-36c4-4ab5-82b1-99305b5d8116 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.811435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.850785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.851178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.851462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.851744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.852489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:27.852799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:27.854234 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:27.856974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:27.869565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 288/562] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:27.870527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.901634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451757f9-1151-4853-9a22-fdc15108f301 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:27.943958 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:27.944771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:27.945055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:27.945334 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:27.956070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:27.964059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:27.965169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 275/563] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:27.966114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:27.985593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7d6a-6823-4318-8c0f-fa6aa54c6781 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.020648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.021444 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.021726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.022004 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.033535 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.035048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6cc15899-947e-4d55-9b5d-341520bedcad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:28.052770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.053875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.054898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:28.054898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:28.054898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.054898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:28.054898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 289/564] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.055230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3571-f57e-4621-9e06-344b802698cc None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.055607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3571-f57e-4621-9e06-344b802698cc None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.055762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3571-f57e-4621-9e06-344b802698cc None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.057356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 290/565] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:28.058056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3571-f57e-4621-9e06-344b802698cc None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.077213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.092107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0849e2-349c-48a2-9def-f41ce8974c69 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.124919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.130400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.131862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.132145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.132425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.139507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.140989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-a2423c34-4700-4591-a50a-ec2d5949cc30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:28.156549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.157590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:28.158586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:28.162539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 276/566] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.163872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.164164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.164446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.176629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3571-f57e-4621-9e06-344b802698cc None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.182808 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:28.184033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:28.216882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.217574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.217860 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.218144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.218948 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.219581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.221004 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.230977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 291/567] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.231649 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.268078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 277/568] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:28.269293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.337424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.364017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77d737-5922-4587-811f-a650ddfba88f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.376545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421ad8b-6a92-441a-9f96-e211bb06ef3b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.399680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.402195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.402914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.403202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.403484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.404292 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.404523 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.405912 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.411209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.411868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.412147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.412421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.413205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.413510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.414991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.417750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 292/569] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.418544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.427546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 278/570] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.428322 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.518857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953d61-5f32-42bb-8b59-0034ac57292b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.529248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba3a6-1074-4a4d-8798-7d9c1327bb67 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.553223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.554057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.554340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.554616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.557505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.562556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.563389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.563778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.563982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.565837 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.567319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.575131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-97a99cae-6c0e-4b84-a3c1-b75a36650d79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:28.583338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.584551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:28.585486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:28.586283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.587197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.588412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:28.588412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:28.588412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:28.588412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:28.588657 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 279/571] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.588758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 293/572] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.588758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.589042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619c8-4fe0-46a5-bf90-22323f59028c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.589488 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619c8-4fe0-46a5-bf90-22323f59028c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.589908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6619c8-4fe0-46a5-bf90-22323f59028c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.591607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 280/573] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:28.592327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6619c8-4fe0-46a5-bf90-22323f59028c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.636787 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.689541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5b3b9-64a6-4d2e-ab3b-65956489e73b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.694891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6619c8-4fe0-46a5-bf90-22323f59028c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.724471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.725361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.725720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.726005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.727675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.728517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.729100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.729376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.730224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=dd3e6ff060e14b3687689f48ffb99e16) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.730541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.732054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.732922 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.734364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.737580 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 281/574] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/role_assignments?user.id=dd3e6ff060e14b3687689f48ffb99e16&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.738446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:28.749668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:28.750814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:28.751826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:28.755983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 294/575] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:28.756995 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:28.818558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.858795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d3795-130c-4845-9327-befc55f9e7da None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.866939 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:28.885244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281e12-4407-465a-a79b-a77aab142629 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:28.896902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.897592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.897886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.898162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.898969 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.899279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.900792 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78c13-0f6b-4b90-be97-46d8d3c2205a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.914270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 282/576] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.914270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.914270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.914270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.931026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:28.932296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:28.941442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:28.942485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:28.942615 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:28.942915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:28.943787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:28.944103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:28.945551 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:28.959114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 295/577] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:28.964219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.005117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 283/578] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:29.005979 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.075593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e197ef-5286-42ed-9536-308acda673c1 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.086932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.111874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.115838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce64554-0cb5-4df6-aa56-a6d75e559a3f None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.118418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.119153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.119437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.119715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.120521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:29.120836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.122287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.140277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 296/579] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:29.141299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.150836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.151629 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.151917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.152202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.162652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.164184 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:29.183022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.184045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 284/580] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.185081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.269871 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce07a-c1c8-44a2-baf2-f08ccdff45e7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.298342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f7b6-0d53-4bb4-96c0-a31c9a0211c8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.307053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.307986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.308465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.308664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.317109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.318569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:29.337964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.339231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 297/581] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.345500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.347892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.348809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.349164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.349514 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.360749 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:29.368752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.370002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:29.371349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:29.372203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 285/582] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.372993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.373133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.387239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.452242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059fc29-c371-425e-b254-946365d2ed02 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.482637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf82fd6-2c80-460d-b7f7-758a341f09fa None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.490558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.491872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.492324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.492768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/2abc2e4d2a924c5795ff69cd3a08ea0a/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.508613 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=2abc2e4d2a924c5795ff69cd3a08ea0a, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.510119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.517737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.518456 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.518723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.519010 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.519787 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:29.520110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.521600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.534854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 298/583] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:29 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/2abc2e4d2a924c5795ff69cd3a08ea0a/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:29.534854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.540228 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 286/584] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:29.541289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.647324 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.648453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.682903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b589-5efd-44b5-b01a-a48b16000b57 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.692049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06253d27-fb64-4075-afa1-5281d95cf229 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.728853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.730309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.730821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.731103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.732070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:29.732387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.733822 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.737391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.738068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.738347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.738618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.739788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:29.739788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.741129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.751565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 287/585] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:29.752277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.756517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 299/586] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:29.758925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.869246 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbac34-500f-44c2-b5f2-d204555c8ecc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.879744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0781e1f-5cb4-4806-a08c-225a3223d138 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:29.910223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.911451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.911962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.912589 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.916724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.923063 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:29.923875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:29.924155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:29.924428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:29.929705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.931240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.937972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:29.940270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:29.950019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.951077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.952082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:29.952082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:29.952082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:29.952082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:29.952082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:29.956041 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 300/587] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.957224 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:29.960399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:29.961436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:29.962503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:29.966766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 288/588] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:29.967886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.067161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b98-c863-48bf-9193-2be72f0fd4a8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.099778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320faa00-b318-4c79-ba5d-8aaeb7a9bb59 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.102106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.103030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.104022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.104022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.114064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.115611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:30.139258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.140303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.141392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:30.141392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:30.141392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.141392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:30.141640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.141640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.141640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.141640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.141951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.142534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.143598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.144597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 301/589] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.145878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.161093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 289/590] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.161916 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.196732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.226908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.270479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815e365-ffa6-4332-b935-9bfe597c5979 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.283991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216053e2-47e7-4078-9219-ba7a928ef72d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.313721 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.314650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.315087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.315464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.316527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.316944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.318560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.329642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.330332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.330614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.330917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.331664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.331975 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.333383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.352441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 290/591] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.352441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.352707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 302/592] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.355769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.469636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a551-5581-4290-a93d-3df9bf0d23d0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.473307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.477364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14241f5-8b4a-4f26-8fa6-a95772f34167 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.485576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.510079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.511419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.511892 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.512453 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.520983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.521148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.521902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.522195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.522476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.523489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.530932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.532390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:30.539644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.540688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:30.541836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:30.544231 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 291/593] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.545301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:30.546740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.547727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:30.548728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 303/594] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.554061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.667651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efe25-a7b1-48d2-867b-8edab9b0eb16 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.686271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1cd4-5bbf-402a-9f7a-74b6a60b43db None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.705646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.706812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.707331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.707820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.708981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.709503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.711213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.725230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de154-1891-4b82-afde-138238842fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.726009 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de154-1891-4b82-afde-138238842fb1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.726297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de154-1891-4b82-afde-138238842fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.726579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309de154-1891-4b82-afde-138238842fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.731764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 304/595] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:30.732897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.738918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de154-1891-4b82-afde-138238842fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.740423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309de154-1891-4b82-afde-138238842fb1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.752285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-309de154-1891-4b82-afde-138238842fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:30.758507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.759764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.760878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:30.760878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:30.760878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.760878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:30.760878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 292/596] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.761194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de154-1891-4b82-afde-138238842fb1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.788104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:30.852228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308c8df-4e9d-43e9-bde0-eaea430e9130 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.871860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309de154-1891-4b82-afde-138238842fb1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:30.891697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.892391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.892715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.892999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.893809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:30.894122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.895846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.909734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:30.911246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:30.911746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:30.912214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:30.914112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 305/597] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:30.915082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.925950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:30.927735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:30.945696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:30.946883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:30.947945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:30.947945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:30.947945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:30.947945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:30.950029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 293/598] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:30.951034 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:30.998101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.024136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f776c9-f215-4a22-82b2-ff501fed18b0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.034170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.060449 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.061219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.061572 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.061739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd6a9-e81a-4e26-ae35-970d55e9447f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.061972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.062836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.063215 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.064670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.078442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 306/599] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.079294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.102656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.103677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.103940 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.104219 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.118652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=3f6fce810ff642dfa15292494084197e, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.120258 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccb397-b1d4-4a61-a0eb-2bc399a0d68a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 294/600] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:30 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2108-769a-44fb-be5a-fa01f4d50c03 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2108-769a-44fb-be5a-fa01f4d50c03 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2108-769a-44fb-be5a-fa01f4d50c03 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 295/601] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:31.142718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2108-769a-44fb-be5a-fa01f4d50c03 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.213939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fac256-0fa4-4717-a50e-9d247858cfa7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.260648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2108-769a-44fb-be5a-fa01f4d50c03 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.264782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.265477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.265760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.266038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.267526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.267955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.269556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b90a13-7f06-4119-b36e-b2f71817a155 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.273845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.289012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 307/602] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.290524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.291014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.291398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.299025 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.311233 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.312109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.312398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.312678 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.321841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:31.321841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:31.325798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.325798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:31.341388 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:31.342626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:31.343880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:31.350495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 296/603] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:31.351669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.401576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 308/604] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:31.402481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.475026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480d8fa-6b08-474e-8533-6b83c8ea5773 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.524674 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe967afb-9081-4a7a-92a1-48bf79723bc9 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.527572 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.528579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.528720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.528914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.536343 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.537895 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:31.552656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:31.553941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:31.555176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:31.558651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 297/605] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:31.559557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.560635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.574190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.576753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.577819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.578516 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.580934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.581542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.584030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.602083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 309/606] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.603806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.611125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.695814 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa5b6a-dcfc-4c65-8d2b-dca112d5a770 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.722031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf00f0-06c4-47d9-8871-af74de425ce9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.743068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.744823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.745581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.746068 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.758546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.759344 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.759752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.760105 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.761019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.761430 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.762084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:31.763054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:31.771936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:31.773017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:31.773974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:31.775718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 298/607] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:31.775939 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.792133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 310/608] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.793028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.848858 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.886367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4f50-532a-475c-bede-33ae8dfffcb0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.894092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:31.908680 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb837be9-bc81-447d-b8ae-508891b0576d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:31.924738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.925644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.925931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.926204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/7d09b1140a9d4cad95e85b6a094e4865/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.941683 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=7d09b1140a9d4cad95e85b6a094e4865, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.943209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d5a5-f86e-41f6-ba8f-c9ab85cb0ead None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.944100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:31.944782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.945064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.945383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.946702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:31.946702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:31.948049 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:31.961690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 311/609] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:31.961690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:31.969677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 299/610] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:31 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/7d09b1140a9d4cad95e85b6a094e4865/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:31.969677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126559ea-67cb-4705-8066-b14f4be429f9 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:31.969677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126559ea-67cb-4705-8066-b14f4be429f9 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:31.969677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126559ea-67cb-4705-8066-b14f4be429f9 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:31.969677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 300/611] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:31.970473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126559ea-67cb-4705-8066-b14f4be429f9 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.088540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eaa7d-77f9-46f2-bbdc-201124c9abd7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.099078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.110951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126559ea-67cb-4705-8066-b14f4be429f9 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.135361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.136879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.137169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.137778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/ecfc0c1a9b56419fbe33fc10047075b8/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.151997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.152904 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.153315 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.153703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.158029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=ecfc0c1a9b56419fbe33fc10047075b8, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.159562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d4554-e0b5-4147-a5aa-2e5115775a7d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.166719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.168599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.180258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 312/612] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:31 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/ecfc0c1a9b56419fbe33fc10047075b8/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:32.181701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.182042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.182335 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:32.190404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:32.191463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:32.192486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:32.192486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:32.192486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:32.192486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:32.197118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 301/613] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:32.200959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:32.201740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.202203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:32.217369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.298960 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 313/614] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:32.331973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.357342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f841e7-b815-44a6-b1fc-989d7ef57512 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.432445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.433508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.433958 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.434427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.437663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:32.438144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.439809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.458886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 302/615] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:32.462417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.491181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.500316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01277624-8b12-4dd6-9ae0-c803999840b1 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.539719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.540544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.540857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.541144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.549094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.554156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:32.564705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:32.565792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:32.566734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:32.568162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 314/616] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:32.572486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.595421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355039a-164c-4d16-bf4a-d85a5e83a432 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.655145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.655972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.656258 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.656534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.671912 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.673437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.692324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aa3c8-7176-4351-89dd-d506dcfd920a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:32.701675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:32.702822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:32.703869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:32.712461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 303/617] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:32.718249 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.741469 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.742866 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.743564 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.744089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.745286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:32.745781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.748088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.759791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 315/618] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:32.765931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:32.795032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.882804 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e96d3-d1fc-4688-a578-72f9a18900e0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.911044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:32.919592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:32.920707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:32.921126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:32.921506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:32.922470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:32.922714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200195-57c8-4c46-8824-0e6b2a886195 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:32.923188 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:32.924612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:32.948621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 304/619] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:32.951050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.000010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.001275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.001778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.002283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.030620 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.032608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.055946 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54debb80-0b94-4fd5-8549-8b469d18ccb7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:33.064802 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:33.065835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:33.075387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:33.075387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:33.075387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:33.075387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:33.077738 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 316/620] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:33.083880 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.092651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.093491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.093773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.094052 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.105627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.107198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:33.125924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:33.127044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:33.128042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:33.128042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:33.128042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:33.128042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:33.131978 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 305/621] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:33.133261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.175897 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.226869 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.239296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e140f-0f37-4d93-a313-3a0f71001f3d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.275533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.276327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.276742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.277089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.277944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:33.278320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.279840 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.296807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 306/622] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:33.298121 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.330714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5d21-2ccf-428f-ac16-218226caba50 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.405991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6e834-52d5-46ec-8026-8b05c64eecfe None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.439224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.443857 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.444740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.445028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.445310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.448105 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.448836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.449122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.449399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.450147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:33.450458 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.451909 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.460361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.461849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.475021 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 317/623] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:33.477614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:33.478754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:33.479850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:33.480353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.486166 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 307/624] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:33.490313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.654366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c69dd-f14c-42ce-9aea-7a13c550550f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.695930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79802b83-cf21-4acf-b77f-9e6a66a09db3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.715447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.716141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.716428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.716711 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.717525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:33.717841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.719692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.736531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.737365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.737657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.737906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] PATH_INFO: `/v3/users/glance` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.738758 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 308/625] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:33.739302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.750745 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.752265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.756410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-db5b31d2-6a97-4dec-b201-2e8c4f468e3d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:33.769437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:33.771734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 318/626] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f998f-1918-4bd8-b9f6-6bf245ba7720 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.773914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f998f-1918-4bd8-b9f6-6bf245ba7720 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.775618 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f998f-1918-4bd8-b9f6-6bf245ba7720 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.780247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 319/627] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:33.781803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f998f-1918-4bd8-b9f6-6bf245ba7720 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:33.787412 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:33.882342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de218-12d5-42bd-85ee-493f318954eb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.915587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f998f-1918-4bd8-b9f6-6bf245ba7720 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:33.925423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.926385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.926670 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.926971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/dd3e6ff060e14b3687689f48ffb99e16/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.943862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=dd3e6ff060e14b3687689f48ffb99e16, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.945763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9ccbf-3b35-40a3-92d1-4b345daa5edd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:33.970800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 309/628] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:33 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/dd3e6ff060e14b3687689f48ffb99e16/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:33.970800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.970800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.970800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.971661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:33.972045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:33.972045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:33.972554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:33.973611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:33.973925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:33.976103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.005917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:34.011532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:34.024767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 320/629] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:34.030192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.118276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.142925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.154165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 310/630] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:34.192462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.208940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5806-f1d0-4d35-b8e4-0d2956f28df9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.289009 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.289616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.289903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.290485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.335410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b535e-c4fb-47a9-9c97-492d95b348a4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.372767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.374306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.379927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.380739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.381024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.381305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.395333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:34.406158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.407284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:34.408227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 311/631] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:34.416439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.423509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.493373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 321/632] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 20:25:34.503827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.553483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.642718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0a65-1b59-4ea0-a88d-23c698b2c083 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.694400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdd017-70d4-4c1f-a25b-f8ae13a85fb9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.710537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.711248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.711530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.711806 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.712567 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.714176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.715618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.729155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 312/633] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:34.737786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.775368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.776190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.776469 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.776736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.794015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.798271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.800082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-2ddac558-73a2-4c6f-90dc-4eb8156855c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:34.826267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.827361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.828359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:34.828359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:34.828359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.828359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:34.830823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 322/634] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:34.832318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142be79-77cc-4863-ba5c-af28f68730a2 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.832894 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142be79-77cc-4863-ba5c-af28f68730a2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.833965 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142be79-77cc-4863-ba5c-af28f68730a2 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.835767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 323/635] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:34.836804 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142be79-77cc-4863-ba5c-af28f68730a2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:34.889117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1dc13-444d-470a-8b67-0356c4a5bf77 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.915915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:34.934615 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.935467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.935750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.936205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.947176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.948767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.952489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142be79-77cc-4863-ba5c-af28f68730a2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-bb20e732-f8f1-44d1-b28a-9debd1fd883e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:34.966353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:34.967565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:34.968564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:34.968564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:34.968564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:34.968564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:34.972587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 313/636] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:34.973606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.973887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.974167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.989236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:34.989934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:34.990182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:34.990420 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:34.991183 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:34.991486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:34.991770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:34.992868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5c569-ae93-4b98-b5b7-39cdc2e9e296 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:34.992986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:35.005505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 324/637] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.006905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49928-907d-48ca-adbe-8caa04b1503d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.007193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49928-907d-48ca-adbe-8caa04b1503d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.007471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd49928-907d-48ca-adbe-8caa04b1503d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.010724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 325/638] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:35.010724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd49928-907d-48ca-adbe-8caa04b1503d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.069226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.074301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 314/639] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:35.075188 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.127052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd49928-907d-48ca-adbe-8caa04b1503d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.163639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.164356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.164643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.164923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.165653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.166079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.167511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5677d7c-5878-4c6e-a505-871c59899fac None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.183596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 326/640] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.183596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.183596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.183596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.196106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f26aa-cc93-4619-8948-78d83fe9691d None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.197362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:35.198043 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.198563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:35.233305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.234106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.234397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.234728 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.241348 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.242994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:35.256497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:35.257575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 315/641] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:35.258592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.298719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 327/642] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:35.298719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.344031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.392724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de1f9c-460d-4d72-a6c7-092418b1f7fa None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.408713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ead79-faab-42e3-88a7-bf4e8532e39f None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.430571 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.431450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.431769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.432050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.442612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:35.445421 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.446232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.446521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.446833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:35.450386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:35.451458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:35.452445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 316/643] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:35.453234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.458727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.458727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:35.475199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:35.476504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:35.477762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:35.481675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.482643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 328/644] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:35.483545 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.560633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df1ec-0027-4a76-b5cd-5ab8be05099f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.591434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12473e-a864-43d4-96c1-88d68fd85845 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.593387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.597911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.598588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.598902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.599185 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.600012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.600325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.601813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.614351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 317/645] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.615206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.637018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.637833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.638119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.638398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.649587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:35.657352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:35.658407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:35.659510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 329/646] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:35.660315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.710494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.734506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6356-19c7-4dab-99d7-81acadc7fc65 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.770007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045b1ba-0985-4b7f-b016-70080af20323 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.776444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.777630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.777893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.778201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.778999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.779769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.781727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.792305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 318/647] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.793110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.809781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.810471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.810785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.811064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.812029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.812340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.813919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.837252 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 330/648] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.837252 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.860247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.901969 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d8541-2656-4942-a5f2-7920345bcad1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.936614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.937283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.937568 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.937847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.938714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=2abc2e4d2a924c5795ff69cd3a08ea0a) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.939044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.940511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:35.946774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 319/649] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/role_assignments?user.id=2abc2e4d2a924c5795ff69cd3a08ea0a&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:35.947447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e4b6-3f94-4361-b8de-147b6595f037 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:35.947580 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:35.966643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:35.989436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:35.990149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:35.990416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:35.990911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:35.991702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:35.992014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:35.993441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.007685 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 331/650] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.007685 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.103677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.110365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28037bda-1cfd-43ad-8b80-365a859dc3b4 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.125923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e9a1-6ef9-402a-ac9c-f438b82256d4 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.163385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.164110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.164393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.164667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.169798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.170816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.171314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.171836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.176666 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.178794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:36.198118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.199223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 320/651] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.200910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.267202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.269038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.276321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.330497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3fbac-6e0d-4117-b42c-9d10aaaed95b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.367113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.367926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.368209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.368480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.379927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.381419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.384793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:36.402660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.403771 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 321/652] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.404765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.410390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 332/653] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:36.412380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.518607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40806-a3bd-4c2f-8d75-2ab9a41cb114 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.532447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.538614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb37a9c-8b0c-45de-b7b1-c93164bb1ee8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.555660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.556396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.556686 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.556954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.557692 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:36.557998 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.559433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.571700 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 322/654] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.572373 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.579612 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.580296 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.580837 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.580837 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.581586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:36.581896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.583307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920ae92-2566-44b1-9472-f5fce4fa96a7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.601413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 333/655] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:36.602857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321efe7-5ad1-4ee9-9fd5-80cbb2a97b8e None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.603146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321efe7-5ad1-4ee9-9fd5-80cbb2a97b8e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.603504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321efe7-5ad1-4ee9-9fd5-80cbb2a97b8e None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.606181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 334/656] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:36.606181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321efe7-5ad1-4ee9-9fd5-80cbb2a97b8e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.663336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.685298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0337-6bbd-4a5a-9062-0049c660f9c1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.721365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.722313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.722670 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.723001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.726757 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321efe7-5ad1-4ee9-9fd5-80cbb2a97b8e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.733580 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.735111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:36.753354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.754395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 323/657] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.755425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.767530 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.768352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.768690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.768984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.777173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.778641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.781958 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a775d323-0233-4845-9aac-e6f19ef3995e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:36.793875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.794972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:25:36.796660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:36.799798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 335/658] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.800971 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.801264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.801760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.819001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:36.820203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:36.865175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b6d93-47dc-4276-919e-f5f6988d42fd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:36.899488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 336/659] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:36.900418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.903574 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:36.904496 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:36.904850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:36.905203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:36.913268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:36.914992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:36.931406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:36.932600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:36.933628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 324/660] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:36.934285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:36.948762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.018224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.027875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5f7f8-7877-43cd-b7ca-15e12b0f3a94 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.035699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd00d4-c80a-4f98-b394-3c7b26f5063b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.062673 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.063381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.063664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.063944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.064669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.064975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.066345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.072242 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.072922 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.073474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.073474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.074325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.074677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.076120 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.079280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 337/661] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.080090 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.099820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 325/662] 10.222.0.77 () {56 vars in 1137 bytes} [Thu May 19 20:25:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.100494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.181486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.192086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dff9fc-2851-4493-beb3-b58a341d4629 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.199026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904530c-091c-479d-9e7d-c142118564cb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.233201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.234051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.234313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.234593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.236531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.237217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.237504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.237791 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.238650 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.238998 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.240477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.246479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:37.254401 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:37.255595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:37.256653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:37.257417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.263159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 338/663] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:37.263159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.263418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 326/664] 10.222.0.77 () {56 vars in 1139 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.263418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.366577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f997-b15a-47af-bb22-436ca96b3369 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.385136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b00c3f-b3bb-47ae-988a-fdd64dd0102d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.403576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.404244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.404533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.404818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.423001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.424362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.425040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.425828 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.435049 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.437236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:37.456608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:37.457623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:37.458678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:37.464943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 339/665] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:37.464943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.475943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.479243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.481717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.484287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.567916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586a1e-3580-4ab5-9aea-c0e0375f065f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.590356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 327/666] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:37.591085 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.610082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.610907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.611195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.611475 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.612236 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.612546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.613942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.622709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 340/667] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.623444 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.702754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.704572 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.706636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03f60e-eec6-4318-95a1-dbd15310e6aa None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.732170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42401d1-5964-46e2-b86c-889be537828f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.747304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.748307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.748603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.749004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.771543 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.772355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.772487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.772765 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.773573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:37.773887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.775423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.789543 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 341/668] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:37.790792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.822120 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.823658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.896435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344413f4-37c4-451f-9beb-e527ff365ec6 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:37.926930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.935358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:37.935789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 328/669] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:37.936388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:37.936672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:37.936949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:37.938223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:37.939183 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:37.950983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:37.952524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:37.972187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:37.973450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 342/670] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:37.974443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.054033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf186-016a-4de7-9fbc-0ef13deb857a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.088760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04381ad-7de4-45ce-b099-e2c3f34e68d6 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.089305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.089984 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.090526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.090839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.103754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.105239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:38.124091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.125194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.126931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:38.126931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:38.126931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:38.126931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:38.127199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.127199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.127199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.127199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.127544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 329/671] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:38.127544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.131169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.132386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.133012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.151158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 343/672] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:37 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.151158 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.199726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.217068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.256667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087191aa-9165-4b89-93ee-6b0a8c6f8041 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.291113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0721c70-45fe-49c0-a7b9-45d7e0b6cb81 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.297860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.298703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.298999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.299284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.312261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.313808 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:38.343854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.345521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.346533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:38.346533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:38.346533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:38.346533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:38.346533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 330/673] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:38.347044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.355122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.355816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.356100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.356380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.357143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.357459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.358899 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4a54-a4e2-4661-a49c-6e369c19b594 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 344/674] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a224-9bdf-4d7a-af44-a9904d20a1ce None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a224-9bdf-4d7a-af44-a9904d20a1ce None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a224-9bdf-4d7a-af44-a9904d20a1ce None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 345/675] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:38.379007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a224-9bdf-4d7a-af44-a9904d20a1ce None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.463173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667f669-91c3-4bfe-af12-db525fffb9b1 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.465754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.496642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427a224-9bdf-4d7a-af44-a9904d20a1ce None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.500966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.501637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.501915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.502186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.502952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.503256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.504773 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.508022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.518786 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 331/676] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.519643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.538155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.538863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.539147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.539422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.540146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:38.540454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.541852 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19e33e-994c-4bac-9ed8-10d3dd7298b2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.554479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 346/677] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:38.560023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.560325 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.560607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.577710 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:38.579023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:38.625712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57442c8-7f74-43f7-9e40-8d136f1c2557 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.652723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 347/678] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:38.653578 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.675573 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.677774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.678498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.679070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.687895 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.689584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:38.704270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.705311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:38.706319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 332/679] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:38.706910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.736305 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.772110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:38.776326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a28625-17d4-4bd5-a2c8-567e0a501e88 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.814015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.815140 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.815579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.815719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abf917-a3a3-473b-852b-75ab9920dd2e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.816132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.824559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.826217 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:38.843797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.845300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:38.846565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:38.852844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 348/680] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:38.852844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.859986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:38.861261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:38.861549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:38.861824 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:38.869922 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:38.871454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:38.885610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:38.886577 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:38.887643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 333/681] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:38.888191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:38.963823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354786-4469-49d8-934e-395ed7bd3f55 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:38.983276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.001056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23fe7b-c79d-4664-95d0-6289d0a531a0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.002553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.003397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.003680 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.003956 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.014995 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.016541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:39.034282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:39.035522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:39.036544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:39.036544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:39.036544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:39.036544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:39.036544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 349/682] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:39.036868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.042114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.042830 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.043115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.043392 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.044199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.044516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.046123 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.052978 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.063622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 334/683] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.063622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.150925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806031dd-8583-4225-b328-b9cc23243955 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.169165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ddf10-c0b3-4ce8-8f13-dd67d11c3837 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.184540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.185212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.185504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.185770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.186610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.186965 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.188398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.205853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 350/684] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.206444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.206943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.207731 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.208173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.208595 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.209520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.209957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.211599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.225061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 335/685] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.226178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.230663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.293321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.331287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09618f28-c20f-445b-a82f-a52158f25c8f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.336901 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b1bb5-9f98-4495-ba15-3980941dab69 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.367856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.368534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.368891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.369173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.370036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=7d09b1140a9d4cad95e85b6a094e4865) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.370352 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.371934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.375610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.376657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.377006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.377278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.378011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.378312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.391028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 336/686] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/role_assignments?user.id=7d09b1140a9d4cad95e85b6a094e4865&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.391028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.391386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.404973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 351/687] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.406000 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.468057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.511888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d35c7-85d0-4e11-b9da-a92c754bad20 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.551209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1537f2-fc33-4ce8-b241-bdf62b968803 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.555841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.556561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.556844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.557120 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.593210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.602814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.603907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.604428 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.604935 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.606110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=ecfc0c1a9b56419fbe33fc10047075b8) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:39.606637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.608479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.614980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 352/688] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/role_assignments?user.id=ecfc0c1a9b56419fbe33fc10047075b8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:39.616022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.647004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.649287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.745919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ae0f-61a3-46ac-bd62-3ee8aff368e7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.751337 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:39.788407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.789098 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.789384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.789666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:39.790390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:39.792186 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:39.799290 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 337/689] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:39.805451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:39.821915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 353/690] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:25:39 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:39.950281 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787fe5f-2e56-415d-b634-ff2717f52dea None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:39.988667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:39.989929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:39.990476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:39.990991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.006256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.008260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:40.029941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:40.032117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:40.033367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:40.033367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:40.033367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:40.033367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:40.035553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 338/691] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:40.041006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.097808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.156402 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f4f13-9d15-4082-8145-a133f0ecdd8c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.195126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.196137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.196613 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.197218 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.198232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.198763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.200358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.213851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 354/692] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.219928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.242889 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.345790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d5588-cafe-4e3b-81db-5c0903ed349e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.401699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.402539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.402857 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.403141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.416999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.418551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-701981d8-f527-465c-9dab-dacb265a119e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:40.439295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:40.440383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:40.441395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:40.444101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 339/693] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:40.449674 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.622615 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf1b53-fd89-4fa6-82e5-0bd5943fe41b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.633330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0afa0a-d787-41b3-92d7-726970669dfa None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.633653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0afa0a-d787-41b3-92d7-726970669dfa None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.633930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0afa0a-d787-41b3-92d7-726970669dfa None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.635633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 340/694] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:40.641902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.642229 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.642711 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.642827 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.668129 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.668721 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.669139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.669433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.670230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.670538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.672016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.683715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:40.684954 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:40.685077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 355/695] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.695703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.802559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42f38-ade5-41a6-af9f-b4699d2b7ed9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:40.832397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 341/696] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:40.839703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:40.840425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:40.840714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:40.840991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:40.841824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=dd3e6ff060e14b3687689f48ffb99e16) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:40.842135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:40.843594 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:40.850456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 356/697] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/role_assignments?user.id=dd3e6ff060e14b3687689f48ffb99e16&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:40.861398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:40.879084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:40.992126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971e3d-f596-4040-ba65-56a235877c89 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.034506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.035361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.035640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.035915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.053332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:41.061193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:41.062326 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:41.063402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:41.067148 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 342/698] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:41.068462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.126447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.199805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0e1e-5f3d-4708-992f-e9eafec71505 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.235566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.236241 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.236525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.236800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.237601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:41.237907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.239375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.248760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 357/699] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:41.254227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.351882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.396235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03891a-0ff6-4cf0-a307-76901f3acb05 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.445216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.446114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.446398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.446675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.459446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.460960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:41.481917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:41.483046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:41.484048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:41.484048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:41.484048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:41.484048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:41.484048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 343/700] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:41.490173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.634127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.646515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25a8ac-19e7-41aa-ad1e-1d78bd6b6edd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.686193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.687169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.687637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.688087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.688972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:41.689431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.690975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.708461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 358/701] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:41.714203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:41.862405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1999f0-1fc8-4cfc-bc72-5259cc671c8a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:41.893138 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:41.910229 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:41.911070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:41.911357 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:41.911636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:41.923255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:41.924779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:41.944088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:41.945168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:41.946230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 344/702] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:41.953370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.103131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764d7b8-8259-4067-9deb-3eeafc048dc3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.146353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.147468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.147966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.148464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.149529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:42.150125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.151816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21227591-3703-4542-a80d-6a1b050bade2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.170959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 359/703] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:42.176888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.309915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a65d4-5625-48a4-adab-f914424fed51 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.356579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.357248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.357534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.357815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.416712 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbca9-b937-48d5-ace2-51ee72a941b9 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.417232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbca9-b937-48d5-ace2-51ee72a941b9 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.417232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fbca9-b937-48d5-ace2-51ee72a941b9 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.418856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 360/704] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:42.423959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.424245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.424527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.425012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.444539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:42.445947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:42.456112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.456383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.457840 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51837868-4f01-4749-b80b-63502ce46e0e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.557917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 361/705] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 20:25:42.580997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.676553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 345/706] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:42.682749 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37351-1ea9-48cd-9bfc-91a0ccfd22d6 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.683050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37351-1ea9-48cd-9bfc-91a0ccfd22d6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.683338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da37351-1ea9-48cd-9bfc-91a0ccfd22d6 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.685644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 346/707] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:42.686423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37351-1ea9-48cd-9bfc-91a0ccfd22d6 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.731331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c9ca3-2798-48ab-927b-148b289a0714 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.769563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.770387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.770669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.771609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.771609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.772995 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.783499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-08f31df1-3a3a-483f-821a-5979e9f0d43f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:42.787519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:42.789045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:42.790023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 362/708] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:42.791063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bb64-069e-4879-80ba-71f4b9890e44 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.791063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bb64-069e-4879-80ba-71f4b9890e44 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.791063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bb64-069e-4879-80ba-71f4b9890e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.808041 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-1a11bb64-069e-4879-80ba-71f4b9890e44 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:42.809242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-1a11bb64-069e-4879-80ba-71f4b9890e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:42.809655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da37351-1ea9-48cd-9bfc-91a0ccfd22d6 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:42.811567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:42.847269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:42.848074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.848356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.848637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.859406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:42.860906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:42.879293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:42.880303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:42.881300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:42.881300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:42.881300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:42.881300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:42.890912 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 363/709] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:42.891069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 347/710] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:42.891724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65021-8659-45a1-993e-d93432b664b9 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:42.891724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65021-8659-45a1-993e-d93432b664b9 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:42.891905 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.891987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65021-8659-45a1-993e-d93432b664b9 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:42.891987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 364/711] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:42.891987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65021-8659-45a1-993e-d93432b664b9 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:42.999176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65021-8659-45a1-993e-d93432b664b9 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.002542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5155-3b79-4676-ac89-96280f362549 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.033235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.033900 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.034185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.034469 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.035237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.035536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.036923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff73141-edf9-49eb-a7a7-6054db4db359 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.040058 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.040992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.041474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.041946 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.042879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.043406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.044454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.046314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.048062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.053348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 365/712] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.053348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.053348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.053348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.058837 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 348/713] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.059803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.069219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:43.070395 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:43.138731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 366/714] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:43.138972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.183590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460631-9c3d-471e-a31e-f21828e9b3a0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.222206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.223049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.223333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.223612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] PATH_INFO: `/v3/services/network` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.224283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.225696 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:43.240971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:43.242106 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:43.243277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:43.244505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611c55f-6938-4f66-8b29-07dda87f068e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.246180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 349/715] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:43.247136 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.276140 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.286187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.287228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.287447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.287708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.295234 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.296710 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:43.312026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:43.313095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:43.314138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:43.314650 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.315614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 367/716] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:43.315778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.360766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337edf7-def7-4a72-a241-8d9f633e3eb8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.395926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.396651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.396942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.397218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.397934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.398266 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.399715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.414714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 350/717] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.414714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.459286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3602665-8907-4589-a3cd-82205ff07668 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.509947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.510944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.511301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.511646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.525136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:43.533595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:43.534914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:43.536108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:43.542161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 368/718] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:43.543269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.600863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.663656 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fda3-13ca-4790-93a1-5c1d2c53955c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.665646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3341-b6d5-4210-b970-4dbfc1ad6225 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.696998 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.705857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.706899 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.707378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.707657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.708459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.708769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.710201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.711414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.712321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.712913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.713271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.714056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] RBAC: Adding query filter params (name=network) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.714429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.716211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.726061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 351/719] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.726061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.731750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 369/720] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.732765 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.834763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3b25f-5353-4ee6-8851-3e74d1568d65 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.857230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff52ce-3bb2-4635-a6c4-86ae39a40895 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:43.867272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:43.868384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.869073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.869355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.869763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.870526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.870861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.872259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.880524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 352/721] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.881321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.901640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:43.902767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.903342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.903771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.904676 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] RBAC: Adding query filter params (type=network) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:43.905139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:43.906805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366adaf-035a-468e-8d89-dbadd2385ac8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:43.913123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 370/722] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:43.922987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827ef2-d080-466f-9f7f-4d117678928f None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:43.922987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827ef2-d080-466f-9f7f-4d117678928f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:43.922987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8827ef2-d080-466f-9f7f-4d117678928f None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:43.922987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 371/723] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:43.923318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8827ef2-d080-466f-9f7f-4d117678928f None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:43.975144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.000198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d766c92-4573-4497-8350-328bdbffa715 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.049468 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.050149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.050432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.050743 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.051614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.052572 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.054444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827771-23f1-4369-b712-906f7c294ed8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.064838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 353/724] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.066311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.066654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.066996 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.077694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8827ef2-d080-466f-9f7f-4d117678928f None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.108592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:44.113268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:44.147824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.149019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.149496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.149997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.167549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.169974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:44.193373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:44.194462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:44.195481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:44.195481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:44.195481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:44.195481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:44.198789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 372/725] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:44.203317 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.214492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 354/726] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:44.236527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.241250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.307083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.336524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c43760-c1c3-4735-9081-127ca358a13f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.372115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.372819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.373100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.373382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.374110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.374422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.375845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.378972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dc890-ca10-4b3a-a6e0-315e7895a0d6 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.396927 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 373/727] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:44.402426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.421475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.423451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.425080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.425561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.449677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:44.466020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:44.467139 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:44.468099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:44.477215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 355/728] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:44.479965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.552526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.581278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a8938-be19-40ad-931e-9da8f3bb2c5d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.677924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c97fe7-354e-440b-ab1c-dd13734c661c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.687179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:44.699479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.700332 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.700762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.701047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.724082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.725538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.728512 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:44.729178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:44.729454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:44.729725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:44.730482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:44.730805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:44.732351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:44.752799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:44.753974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:44.755063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:44.755686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 374/729] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:44.761194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 356/730] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:44.762035 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.782745 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:44.981252 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7fee2-66c3-438d-ac00-e4cdedd9d779 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:44.984751 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93921-2c91-49a0-9afd-17c1b86241c9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.027624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.028316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.028602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.028882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.029812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:45.030127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.031593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.058016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.058874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.059161 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.059499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.068684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 375/731] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:45.072573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.075998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.083493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.084986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:45.123634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.124709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.125693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:45.125693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:45.125693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.125693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:45.125693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 357/732] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:45.140471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.183030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.230518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe13413-6d22-414c-930c-7fed8a3b2e38 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.301040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.301631 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.301919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.302291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.330505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f9067-f628-4198-8b73-b15993ddd3e5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.400270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.401794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.403170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.403703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.404644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:45.405945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.407769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.429707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 358/733] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:45.438810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.449365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.449365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.449365 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.581942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.614988 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4ba9-05d4-4264-8b85-460ae7c68c81 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.617979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 376/734] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:45.623416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.688078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.688920 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.689205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.689484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.707545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.709048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:45.734802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.735903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:45.736941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:45.740019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 359/735] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.747884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.805279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fad0-5cb8-46f9-a70c-1a3e6894c89a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.808585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.859620 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.860951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.862214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.862750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.881605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.881605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.899274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed59e-9e07-4a6a-9a89-7afb2647b007 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-502d0b62-4f7d-4759-aa5d-e67151d7a934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:45.901329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:45.902320 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:45.903345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:45.903345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:45.903345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:45.903345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:45.905653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 377/736] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:45.907166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5a2a-8a64-4b25-81a5-589dedb3ff47 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.907648 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5a2a-8a64-4b25-81a5-589dedb3ff47 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.908126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c5a2a-8a64-4b25-81a5-589dedb3ff47 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.909871 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 378/737] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:45.918460 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c5a2a-8a64-4b25-81a5-589dedb3ff47 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:45.944076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:45.944926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.945208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.945521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.946385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:45.946777 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:45.948535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02dcc-2e30-4469-bc05-4720509ea198 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:45.959340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:45.970073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 360/738] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:45.971633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:45.971923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:45.972198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:45.989693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:45.990936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:46.043160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c5a2a-8a64-4b25-81a5-589dedb3ff47 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.074982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 361/739] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:46.076320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.084575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.085263 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.085585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.085823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.086569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.090754 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.090754 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.107705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 379/740] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:46.109150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.130398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.223314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6127d-843d-4f80-a0a6-ad84ec1ca2a0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.241896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e92540-06ea-471d-9f1a-2695cf6c059c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.263878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.274276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.275404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.275691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.275970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.288150 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.289859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.290352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.291254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.300768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.303436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:46.326070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:46.327353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:46.328383 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:46.331566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 380/741] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:46.332709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.371914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.373767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.416963 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.446209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5fe9-cb8f-43f7-afa0-bee3ed2a1e26 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.483566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.484271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.484558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.484839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.485580 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.487001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.487923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 362/742] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 20:25:46.489342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.510808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 381/743] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:25:46 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:46.512228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.528355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.627539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bef90c-ed82-4608-970a-9904f922a037 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.652883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6d33c-c1ea-4c03-b7cb-b4b00d0d21d4 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.666046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.667042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.667268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.667508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.668338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.668661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.670391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412de33a-c967-4bc9-938c-1176d571bb35 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 363/744] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bab5-d3b8-4442-bac0-dc04713ee0f5 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bab5-d3b8-4442-bac0-dc04713ee0f5 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181bab5-d3b8-4442-bac0-dc04713ee0f5 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 364/745] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:46.689077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23fe4d-4fe8-480f-a294-ec622c67a345 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.689659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23fe4d-4fe8-480f-a294-ec622c67a345 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.689659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23fe4d-4fe8-480f-a294-ec622c67a345 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.690628 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 365/746] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:46.693958 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23fe4d-4fe8-480f-a294-ec622c67a345 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.696025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.703635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.704228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.704525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.704986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.716284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.717772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-470b0096-3f8f-4ae5-8935-8efe76467176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:46.737229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:46.738283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:46.739313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:46.739313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:46.739313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:46.739313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:46.739313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 382/747] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:46.740062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3eac1-bf1b-449a-8281-07b2370eef79 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.740062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3eac1-bf1b-449a-8281-07b2370eef79 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.740306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3eac1-bf1b-449a-8281-07b2370eef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.758359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-98a3eac1-bf1b-449a-8281-07b2370eef79 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:46.763811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-98a3eac1-bf1b-449a-8281-07b2370eef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:46.792960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:46.807256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23fe4d-4fe8-480f-a294-ec622c67a345 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:46.838216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 383/748] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:46.839684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.840043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.840385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.852393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:46.853344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:46.853817 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:46.854343 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:46.855405 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=8e02c0005bd4418aa02b54f2855f46dd) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:46.855908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:46.858177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:46.863338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:46.864566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:46.865394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 366/749] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/role_assignments?user.id=8e02c0005bd4418aa02b54f2855f46dd&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:46.866132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:46.943353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 384/750] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 20:25:46.944213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.001873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.012016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1cf08-bfb4-42e1-bef9-d91a5b5dd030 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.052344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.053802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.054358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.056423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.057407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.057813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.059475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.073874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 367/751] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.074915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.077249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bc2b5-9c1f-4e42-b555-9e4c9c498483 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.093976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.123354 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.124165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.124455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.124743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.140677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:47.148808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:47.150062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 385/752] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:47.151472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.199858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d5154-ecdf-4f6e-9dce-1d91a7773f7f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.243309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.244089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.244372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.244647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.245376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.247579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.263247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4502c5-ba64-43c3-8968-06628e24d202 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.265440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.268433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 368/753] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:25:47 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:47.269381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.358250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.359283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.359640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.359754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.360006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.379725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.381245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.397408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cf8ea-17a7-4193-9b7f-bdd5f92d537a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:47.415602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:47.416684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:47.417668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 386/754] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:47.423718 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.435179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.435873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.436290 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.436569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.437341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.437651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.439202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.452653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 369/755] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.459022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.586076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f3c72-604c-4b25-a8b5-957ae138e0a2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.595640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a50b0-d3f9-4c82-800f-e4f56ed53640 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.629636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.630442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.630911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.631188 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.634971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.639521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.640199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.640481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.641269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.642017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.642331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.644566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.644718 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.646132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.664378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 387/756] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.666203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:47.667780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:47.668747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:47.669906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:47.669906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:47.669906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:47.669906 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:47.672959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 370/757] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:47.679723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.696399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.808941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6dc51-8fd1-48b8-a99b-07a4979c9ac8 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.850308 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.851167 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.851455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.851734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.852721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.853177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.854500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.869151 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 371/758] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:47.876278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:47.898024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac728-7bcb-43f4-812e-f011157e9e02 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:47.967956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:47.975432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:47.976125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:47.976414 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:47.976695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:47.977543 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=dd3e6ff060e14b3687689f48ffb99e16) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:47.977879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:47.979388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:47.991418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 388/759] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/role_assignments?user.id=dd3e6ff060e14b3687689f48ffb99e16&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:48.036105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2044ff-1988-4f90-bb52-0cc6d12a9f11 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.083147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.083964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.084248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.084517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] PATH_INFO: `/v3/users/nova` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.104766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.106630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:48.135460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:48.136606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:48.137649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 372/760] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:48.144525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.273574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.294441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaeab1-4c85-4fef-a2b1-e00bb7f39f55 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.337618 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.338258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.338549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.338849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.339726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:48.340036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.341491 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.365147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 389/761] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:48.371782 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.525951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0eced-8f9a-4888-8df4-7c281a1d221c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.537332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.575638 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973705-3996-4638-b207-053deb96afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.576455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973705-3996-4638-b207-053deb96afe3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.576739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973705-3996-4638-b207-053deb96afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.577018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973705-3996-4638-b207-053deb96afe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.591593 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973705-3996-4638-b207-053deb96afe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.593008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973705-3996-4638-b207-053deb96afe3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-51973705-3996-4638-b207-053deb96afe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:48.614935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:48.615976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:48.616965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:48.616965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:48.616965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:48.616965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:48.616965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 373/762] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:48.621792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.785747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b783bc-87f2-4b1e-ae4b-81b70dfb786f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.819946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:48.820629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.820917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.821265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.822055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:48.822415 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:48.823827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5798-e730-492f-8447-fa897f7b8009 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:48.832379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:48.835742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 390/763] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:48.841340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973705-3996-4638-b207-053deb96afe3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:48.952745 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973705-3996-4638-b207-053deb96afe3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:48.989815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a41e-70b9-4766-ae21-d8f247a8558a None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.990183 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a41e-70b9-4766-ae21-d8f247a8558a None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.990398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a41e-70b9-4766-ae21-d8f247a8558a None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:48.994707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 391/764] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:48.997332 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:48.997622 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:48.997907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.013143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.014324 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.014861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.015337 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.024934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.028331 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.029410 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:49.030879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:49.052886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:49.053956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:49.054994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:49.064984 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 374/765] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:49.071424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.112601 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.170346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 392/766] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:49.213476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.244658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edab644-bc87-4f12-b333-fb6585958175 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.286001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.287100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.287726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.288212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.289237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:49.289747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.291646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.305713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 375/767] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:49.311675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.364923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8c189-0ea6-48cd-8bb6-70210d6f5308 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.398658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.403830 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.405093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.405410 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.405693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.406579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.409741 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:49.436436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:49.437579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:49.438511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:49.439437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 393/768] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:49.446514 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.525032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.553337 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8878f-043f-48b3-9ace-926a1905f1a3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.591221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.592401 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.592952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.592952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.595274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=3f6fce810ff642dfa15292494084197e, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:49.597355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778a190-c6e9-412c-8a88-ef4e13357896 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:49.615125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 376/769] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:49 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:49.658914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e197-66e9-465a-a12e-f003e1b039cb None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.659289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e197-66e9-465a-a12e-f003e1b039cb None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.659703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43e197-66e9-465a-a12e-f003e1b039cb None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.661664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 377/770] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:49.667961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.668309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.668649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.689539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:49.690865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:49.779669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 378/771] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:49.804531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:49.885723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:49.927178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ecd96-d0dd-4630-ad56-d5c9dbf0da99 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.929688 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb89c-1cde-456a-824d-d52965b9b30a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:49.967894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:49.969379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:49.969664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:49.969943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:49.983113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:49.998588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:49.999753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:50.000762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 379/772] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:50.015749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.016712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.019558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.019849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.020130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.020872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.021188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.022626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.033277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 394/773] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 587 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.034203 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.097413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.135055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62d6a2-37ba-430a-af65-ae9070617e84 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.171142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.178416 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.180108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.181245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.181713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.182816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.185204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.186822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.192087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d225a-dc51-44c9-8178-6d3c41987ef8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.203697 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 380/774] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:50.210325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.263128 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.264234 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.264694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.265284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.266478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.267280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.268813 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a6bef-390c-486f-95ec-78f6c6583d12 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.275748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 395/775] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.277329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714bc1-cacf-47a3-b1ac-33d6c01c76e5 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.277843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714bc1-cacf-47a3-b1ac-33d6c01c76e5 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.278326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714bc1-cacf-47a3-b1ac-33d6c01c76e5 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.280052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 396/776] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:50.281646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29714bc1-cacf-47a3-b1ac-33d6c01c76e5 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.362313 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06036-5778-4d88-8b32-d2f0eba1e0a0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.407153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.408913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.409354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.410053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.415468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29714bc1-cacf-47a3-b1ac-33d6c01c76e5 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.434903 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.437350 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.443512 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.457730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.458616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.459017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.459391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.460369 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] RBAC: Adding query filter params (interface=public, service_id=af8f828f217346578cf97ae22abaa179, region_id=RegionOne) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.460801 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.462396 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-705ae6ff-aeed-48de-bfd8-157391afad28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:50.463203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:50.464339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:50.465547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:50.465547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:50.465547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:50.465547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:50.467883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 381/777] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:50.469634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.470101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.471109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.474890 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 397/778] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/endpoints?service_id=af8f828f217346578cf97ae22abaa179&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:50.475945 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.494212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:50.495725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:50.543075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.571011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 382/779] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:50.572194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.589304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6ec07-0b37-4d69-bad0-f3de3780940b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.627446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.628129 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.628411 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.628686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.629420 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:50.629728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.631137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.647139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 398/780] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.647139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.697691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.698071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadd38e-fdfe-4928-9bdf-c4fed76763a5 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.735873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.736682 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.736973 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.737252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.737950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.739437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1554-7353-4388-b76d-d69a2a06cf7b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.744936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 383/781] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:50.746176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f6ea-7e05-4a2f-afee-cb074de52b51 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.746464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f6ea-7e05-4a2f-afee-cb074de52b51 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.746798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92f6ea-7e05-4a2f-afee-cb074de52b51 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.748234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 384/782] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:50.753383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92f6ea-7e05-4a2f-afee-cb074de52b51 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.776227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43338-1ffc-4375-a4c9-fc4e915fc2d8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.812215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:50.816962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.817798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.818086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.818568 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] PATH_INFO: `/v3/services/network` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.819873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.821869 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-925e513e-2404-4851-9482-1b182ba02353 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:50.835616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:50.837446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:50.838895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:50.842188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 399/783] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:50.843688 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b707f-6c38-404b-843b-53374e149852 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.844342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b707f-6c38-404b-843b-53374e149852 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.844639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b707f-6c38-404b-843b-53374e149852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.865462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-810b707f-6c38-404b-843b-53374e149852 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:50.867151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-810b707f-6c38-404b-843b-53374e149852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:50.912095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92f6ea-7e05-4a2f-afee-cb074de52b51 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:50.957483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:50.957895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 400/784] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:50.958841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b707f-6c38-404b-843b-53374e149852 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:50.963579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:50.963855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:50.964137 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:50.978168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:50.979832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:50.996677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:50.997879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 385/785] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:50.998983 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.018801 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.087569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b707f-6c38-404b-843b-53374e149852 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.111252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.117545 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d3145-7fba-4d6b-928f-d3078c0ffb0b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.129043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.129732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.130016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.130296 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.131121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] RBAC: Adding query filter params (name=network) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.131355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.132736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.142509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 401/786] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.143456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.158190 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.159528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.160112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.160610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.172531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:51.181406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:51.182435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:51.183407 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:51.186301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 386/787] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:51.187365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.265217 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39056a-1314-458c-b486-d9ac939cbbcd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.267918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.298945 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab46c-ca2f-4e47-a7b4-5e0dbb70774f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.304621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.305319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.305606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.305925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.306891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.307209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.308893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.334884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 402/788] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.335998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.341263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.342221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.342744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.343248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.344500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] RBAC: Adding query filter params (type=network) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.345026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.346634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.353000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 387/789] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.354071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.394741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.453839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce169472-3412-4f05-9196-44e4e4f8691a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.489696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.490431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.490742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.491076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.491844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.492154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.492586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eacf6-d980-4a9c-945d-2e14b28f2f26 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.493562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.507073 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 403/790] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.507961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.529365 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.530174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.530458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.530862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.534607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.544619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.547710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:51.566789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:51.568035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 388/791] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:51.570335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.619217 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca9e22-de70-4c9f-9d94-8bb02733b537 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.647329 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.655760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.656440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.656724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.657002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.657811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] RBAC: Adding query filter params (interface=public, service_id=024361a3a8f546f38e2039dafd3beaa6, region_id=RegionOne) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.658124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.659540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.665135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 404/792] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/endpoints?service_id=024361a3a8f546f38e2039dafd3beaa6&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.670363 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.680885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbfa48-4b85-4cd5-a07f-5b7bdb9ee356 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.722115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.723262 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.723553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.724217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.739880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.741390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:51.764734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:51.766901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:51.769107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:51.769107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:51.769107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:51.769107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:51.771981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 389/793] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:51.771981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.772346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.787713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f46eb-9143-4fb5-9383-ebcdfc3c391a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.835061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.836499 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.837493 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.838232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.839208 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:51.839894 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.841858 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.864905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 405/794] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.865986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:51.900419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c99bb-33c7-474d-8e0c-d7cc4a3a2b72 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:51.925059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:51.936891 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:51.937847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:51.938367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:51.938900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:51.939819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:51.941446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:51.946989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 390/795] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:51.948023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.020152 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391f1ac-9ce3-4181-86aa-dc6b89534d79 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.061632 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.062384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.062803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.063088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.063833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.064198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.065599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.084060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 406/796] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:52.085531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.098640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.198345 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795d4c6-1f0c-4ddc-aa4e-70610b40136a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.201939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8013-fae5-470e-abc7-c00eaf936aac None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.241451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.242245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.242624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.242999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.247207 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.248249 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.248764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.249246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.253155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.254651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.257104 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.258823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:52.274005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:52.275148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:52.276221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-6a8beea7-50a4-4eb4-b928-01c4a9a5d6c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:52.276811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:52.277687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 391/798] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6443-1313-4230-ac7d-96535cde1d89 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.278669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6443-1313-4230-ac7d-96535cde1d89 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.279356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a6443-1313-4230-ac7d-96535cde1d89 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.280289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 392/799] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:52.280455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 407/799] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:52.285362 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.285643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.285917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.286071 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.311966 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:52.313732 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:52.364645 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.368627 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.392353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 393/800] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:52.397807 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.414950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df17a-cb2e-42fa-93fc-7befc4a1c025 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.451046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.452123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.452612 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.453092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.454154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.454675 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.456367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.476362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 408/801] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:52.477572 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.510820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf634b-476b-46fa-881f-3f5fff02ff07 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.558796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.559475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.559757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.560086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.560935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.561533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.562850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.580559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 394/802] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:52.581564 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.601760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddc8b-0d0d-4595-9d7c-ce674e818d1f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.625853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.630201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.640473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.641297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.641931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.642219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.653908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:52.661693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:52.662743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:52.663722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 409/803] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:52.664487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.697926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a6979-a4f8-4eb9-977a-6d86a68aba18 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.735467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.736223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.736552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.736832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.748815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.750510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:52.769363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:52.771523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:52.773763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:52.773763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:52.773763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:52.773763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:52.774304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9aad-ea04-4a07-afca-610222d67fe5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.778797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 395/804] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:52.778797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.804578 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.805474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.805752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.806267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/8e02c0005bd4418aa02b54f2855f46dd/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.821886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=8e02c0005bd4418aa02b54f2855f46dd, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.823416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:52.846719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 410/805] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:52 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/8e02c0005bd4418aa02b54f2855f46dd/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:52.846719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:52.925417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.931946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:52.939798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231558a-9a54-46a5-a2c7-a501d1c78b4e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:52.988394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:52.988986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:52.989264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:52.989537 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:52.992874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:52.993189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:52.994712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.016622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 396/806] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:53.025352 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.067309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea0662-c329-485b-8ca6-4efc4d20e7fc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.115364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.116053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.116332 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.116606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.117412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:53.117714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.119812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.140664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 411/807] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:53.142384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.185247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d339-c2cb-4de6-b064-506ec09f7280 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.223627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.224541 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.224824 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.225101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.236965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.238510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c2567fe0-efb4-4fd4-94a9-8e23fe6e7841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:53.257086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:53.258304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 397/808] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:53.260119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d3b7-75be-4355-ba89-f3883e03f4c6 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.260558 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d3b7-75be-4355-ba89-f3883e03f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.260694 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1d3b7-75be-4355-ba89-f3883e03f4c6 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.266132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 398/809] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:53.267060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d3b7-75be-4355-ba89-f3883e03f4c6 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.268055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.273043 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.277058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f96edf-eecc-45f2-91e4-2098b4e76491 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.330823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.331650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.331932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.332214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.339640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.341235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-de9a6194-a699-4dcb-920e-44570b104b25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:53.358950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:53.360025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:53.361061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 412/810] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:53.361877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.362155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.362424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.379586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:53.380775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:53.397471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1d3b7-75be-4355-ba89-f3883e03f4c6 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.446441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.447414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.447705 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.447984 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.449387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:53.449702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.451160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.453391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 413/811] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:53.454425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.474662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 399/812] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:53.477349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.566576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.567148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.573673 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55154d81-8f46-497a-8e90-b810001f06a2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.608833 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf0e63-6aad-42d0-a846-43f448ee07c6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.612031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.612879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.613258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.613609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.614489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:53.614914 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.616431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.634336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 414/813] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:53.635371 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.653487 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.654382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.654667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.654965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.662991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.664469 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:53.683819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:53.684957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 400/814] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:53.686602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.762274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93482b41-9275-430b-8b6b-8f473b293eea None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.795898 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfef61-0704-437d-8aa9-fa9906561a5f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.800585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.801741 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.802238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.802751 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.803730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.805319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:53.820052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:53.821130 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 20:25:53.822167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:53.824169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.826496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 415/815] 10.222.0.77 () {56 vars in 1129 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:53.827916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.837286 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.838215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:53.838510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:53.838795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/dd3e6ff060e14b3687689f48ffb99e16/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:53.841919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=dd3e6ff060e14b3687689f48ffb99e16, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:53.842930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:53.847661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:53.862097 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 401/816] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:25:53 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/dd3e6ff060e14b3687689f48ffb99e16/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:25:53.863069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:53.958237 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5064264-bc46-4f01-b774-3afcacba82fa None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.977706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c018f-5a74-44b7-b013-63ae4fe82dc5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:53.998706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:53.999849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.000452 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.000983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.002078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:54.002613 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.004542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.015629 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.016320 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.016673 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.017726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.017726 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:54.017990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.019387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.025145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 402/817] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:54.027686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 416/818] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:54.034740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.038480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.140699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.165127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.207199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b10bc4-1ed5-4e06-be84-89b80b07f715 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.210730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0df0-6415-4d97-89d1-0edcad1cd998 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.249740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.250845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.251136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.251419 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.282386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.283464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.283942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.284378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.285310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:54.285794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.287618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.305226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 403/819] 10.222.0.77 () {56 vars in 1124 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:54.311352 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.342559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.344684 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.419917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.459991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 417/820] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:54.465856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.500399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601188b-f0ae-41ee-8a90-ba696b3e7937 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.518399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.547381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.548109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.548391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.548665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.549496 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.551458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756a0bd-c77a-4282-93b2-30880bc946f0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.583530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 404/821] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:25:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:25:54.585721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3d8c-1fa0-4851-a426-1d5a414f238b None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.586017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3d8c-1fa0-4851-a426-1d5a414f238b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.586343 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3d8c-1fa0-4851-a426-1d5a414f238b None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.587033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1ebe-fabc-41da-bdcd-23c7431abcd3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.590782 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 405/822] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:54.593868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.594511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.594843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.636066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:54.637701 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:54.653952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.654879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.655229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.655511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.687993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.689385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:54.726601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:54.728780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:54.729977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:54.729977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:54.729977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:54.729977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:54.729977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 418/823] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:54.735909 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.744465 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 406/824] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:54.769670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.813951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.880786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4a1d2-5018-42de-b05d-bd3c46e098f4 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:54.923596 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:54.924277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:54.924562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:54.924870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:54.926181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:54.926507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:54.927922 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:54.944996 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 419/825] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:54.950847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:54.951191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:54.957145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e4be5-c31e-4927-909e-4ee39731f7a4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.004601 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.006239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.006778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.007643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] PATH_INFO: `/v3/services/network` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.008842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.011347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:55.025985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:55.027271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 20:25:55.028215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:55.031896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 407/826] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:55.041260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.061844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.087285 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ea19f-7990-4b26-9070-ba4f4d6ca95f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.125769 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.126645 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.126964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.127295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.134790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.137144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:55.152937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:55.154007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:55.155727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 420/827] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:55.160439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.305064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e9776-e9e4-46ba-8d81-223436a8093d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.328821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b527-dd52-4631-94ab-2971fdaf701a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.349333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.350303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.350761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.351187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.352066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] RBAC: Adding query filter params (name=network) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.352526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.366859 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 408/828] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:55.371397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.394263 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.395015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.395304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.395579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.396388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.396696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.400555 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.407044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.425708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 421/829] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:55.426350 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.431791 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.552928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52a5e-76bf-4a10-a419-dd3b60b4c380 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.614785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.615384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.615663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.615937 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.616461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e21ff-1677-4227-8d4f-f2b7d6694f21 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.616646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] RBAC: Adding query filter params (type=network) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.616950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.618433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e936fec-83b9-4f07-a4fc-039338da4c95 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.624105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 409/830] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:55.625517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4996a-8967-4491-920c-a9d27a529257 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.625803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4996a-8967-4491-920c-a9d27a529257 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.626079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4996a-8967-4491-920c-a9d27a529257 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.630753 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 410/831] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:55.632144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4996a-8967-4491-920c-a9d27a529257 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:55.657595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.658181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.658472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.658780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.659700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:55.660012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.661468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6ac87-5dc8-4b42-bd89-ea389d23b29d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.668096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 422/832] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:55.669484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.669693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.669979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.687657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:55.688930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:55.742153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.767132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4996a-8967-4491-920c-a9d27a529257 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:55.789133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:55.810553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 423/833] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:55.826466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:55.827191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:55.827511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:55.827794 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:55.828618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:55.830102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:55.854338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 411/834] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:25:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:25:55.860708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.015448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86f479-4487-4ed5-8391-dd2ff85dddcd None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.061599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.062419 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.062714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.063053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.075033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:56.082969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.084057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:56.084998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 424/835] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:56.091553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.216443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345f78-a98a-402d-927d-a4f8940e911b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.255609 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.256298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.256578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.256855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.257619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:56.257927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.259406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.268675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 412/836] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:56.274235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.339056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.403597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8d95-66b1-474c-a9f4-691be67491a0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.438489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.439334 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.439622 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.439896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.451243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.452725 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c2d5a60b-8a28-4397-8fd5-306aebe5d756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:56.471232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.472256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.474040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:56.474040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:56.474040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:56.474040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:56.474040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 425/837] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:56.478218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.492576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.559650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b77fd-1226-4a60-bcbd-30cb612ae85b None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.559873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b77fd-1226-4a60-bcbd-30cb612ae85b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.560107 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b77fd-1226-4a60-bcbd-30cb612ae85b None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.561753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 426/838] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:25:56.567032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.567576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.568078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.588959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2380ec-eace-4261-b852-e079a28577a3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.592390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:56.593628 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:56.626331 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.627455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.627950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.628434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.629371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:56.629919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.631594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.645386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 413/839] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:56.655255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.679824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 427/840] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:25:56.703289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.727509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.732810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:56.762535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0fd9b-120c-4fab-8167-c5e4fc4e5225 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.798563 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.799440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.799724 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.800003 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.810165 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:56.811824 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:56.812408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a35efa-2d24-4183-97bb-8fb4859925d4 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:56.831774 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.833544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:56.834746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 414/841] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:56.839848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.856999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:56.858229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:56.858513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:56.858820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:56.873179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:25:56.883026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:56.884276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:25:56.885279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:56.889735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 428/842] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:56.891176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:56.963144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70417f-d8f1-418e-ae46-258caa8cdbcc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:56.992073 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.002013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.003028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.003526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.004064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.005157 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.005678 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.006039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.007933 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.021459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbd6cb-b824-4d20-8c5e-ac5d2c0f3ffc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.028956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 415/843] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:57.034823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.064556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.065164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.065447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.065752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.069564 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.069564 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.069564 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.086085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 429/844] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:57.091578 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.175297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc164-0616-4500-9d01-cede9b91125c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.209503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f4d1-a785-4770-a2fd-99eaf01c5f05 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.220269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.221890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.222420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.222970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.251361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.252549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.253086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.253560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.266627 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.268642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:57.290934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:57.292180 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:57.293350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:57.293350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:57.293350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:57.293350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:57.293635 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.295891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 430/845] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:57.302284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.305956 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.315229 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.317072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ad59c-61da-4e2f-b877-df02efabf2fa None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.417049 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9c8be-87c1-488b-b67a-c8c201a6636f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.425198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 416/846] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:25:57.426779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd578de-edf6-4827-8456-a1b38cac33a6 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.427237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd578de-edf6-4827-8456-a1b38cac33a6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.427664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd578de-edf6-4827-8456-a1b38cac33a6 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.429088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 417/847] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:57.430314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd578de-edf6-4827-8456-a1b38cac33a6 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.461303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.462109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.462390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.462667 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.463424 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.463721 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.465085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6881c0-e36a-44a5-9960-9c5b0c3c4a33 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.483202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 431/848] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:57.483202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.483202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.483202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.497232 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:57.498496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:57.524196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.541202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd578de-edf6-4827-8456-a1b38cac33a6 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.568549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.580098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.580869 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 432/849] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:57.581519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.589935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.590506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.591046 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.606164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.607730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:57.629175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:57.630341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 418/850] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:57.631422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.702033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e98b24-0d53-4b71-88ac-a166b15f0fac None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.741162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.741992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.742276 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.742556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] PATH_INFO: `/v3/users/swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.749931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f609b-2b85-4238-a2ae-55c4d8e4c36d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.753160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.754641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:25:57.770750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:57.777300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 433/851] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:57.778425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.809279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.809279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.809279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.809279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.809863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.811264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:57.824880 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:57.826113 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:25:57.827559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:57.831080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 419/852] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:57.832224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.835187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.845251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:57.905756 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0db7-78eb-4e50-b4de-d1d1c78fd631 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.943101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.943778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.944057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.944330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.944536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e553d-3dcd-4e84-9e8a-2321fb58f87b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:57.945056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.945366 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.947515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:57.958944 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 434/853] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:57.963993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:57.980589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:57.981285 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:57.981673 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:57.981812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:57.982668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:57.983009 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:57.984490 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.008240 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 420/854] 10.222.0.77 () {56 vars in 1135 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.008240 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.068117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7432a-ffa3-49bc-b192-7d02efdb4294 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.072373 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.082807 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.106016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.106882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.107173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.107437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.108174 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:58.108485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.109913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.119954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 435/855] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.119954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.125103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e479b-575f-456a-ae37-2f85ff0a6553 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.164668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.166080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.166375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.166657 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.175211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.176640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:58.191396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:58.193656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:58.195168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:58.201170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 421/856] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:58.201170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.237752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db10c3-9ad4-49e9-9c7e-0d9a31b5c6d3 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.277085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.278085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.278704 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.279157 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.314266 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60743c-e50f-4ca5-88fd-bce58b655013 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.325786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.335525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.350324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.351097 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.351765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.351882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902bc31-5ace-4d7d-9f61-76b813633b5b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.352045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.352318 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.353127 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:58.353429 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.354836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.359913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 422/857] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.360690 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.471681 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00d39-5ed9-4887-9462-962b8228076f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.472145 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 436/858] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:25:58.473625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e64a-8605-4fcb-93c4-231df17096ed None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.473924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e64a-8605-4fcb-93c4-231df17096ed None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.474297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e64a-8605-4fcb-93c4-231df17096ed None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.480094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 437/859] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:25:58.480094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e64a-8605-4fcb-93c4-231df17096ed None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.515476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.516264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.516551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.516828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.517639 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:58.517955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.519477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005e172-9d16-4449-8092-126c2ecd09cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.538503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 423/860] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.538503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.538503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.538503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.556559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:25:58.557766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:25:58.575212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.601194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.601387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e64a-8605-4fcb-93c4-231df17096ed None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.633609 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 424/861] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:25:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:25:58.634926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.646026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.647253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.647750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.648275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.661307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.662877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:25:58.680940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:58.682063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 438/862] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:58.683161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.754924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79961b-55b8-43f5-b31f-a56b36bbf959 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.790654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e395a1-41fb-464b-963a-c44d93dd6abf None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.791669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.792335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.792619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.792893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.793741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=8e02c0005bd4418aa02b54f2855f46dd) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:58.794056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.795575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.810716 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 425/863] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/role_assignments?user.id=8e02c0005bd4418aa02b54f2855f46dd&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:58.810716 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.831195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.841611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.842454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.842770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.843058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.843734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.845484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:58.858929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:58.860126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:25:58.861323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:25:58.862424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:58.866283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 439/864] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:25:58.866468 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:58.950489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85b22-973f-4dd3-86d8-18c0e2f55d18 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:58.990528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:58.991401 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:58.991778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:58.992247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:58.993239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:58.993647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:58.995211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:58.995918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a0f99-32e6-43bc-92d5-77a9a2d0dac9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.009083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 426/865] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:59.014317 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.043557 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.043823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.044117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.044397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.045559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.046373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.048724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.054361 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 440/866] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:25:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:25:59.059463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.127839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.136761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.142130 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d162-d8af-4dac-9f7f-7f1764a900dd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.186733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.186733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.186733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.186733 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.189219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11692a6-14b2-4963-81a7-56e5ef285c36 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.192058 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.193655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:25:59.213234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:25:59.214589 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:25:59.215885 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 427/867] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:25:59.220790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.235281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.236235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.236755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.237137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.238587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.239024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.240932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.247460 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 441/868] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:59.335637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecc8e2-d8ef-47bd-9f4d-074834f76218 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.375642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.376328 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.376611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.376888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.377701 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.378071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.379531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d98829-f799-4ddd-b2ac-4391f0769f90 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.393236 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 428/869] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:25:59.399536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:25:59.515075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46e59-059e-4720-ade4-5640820d8d7e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:25:59.536079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:25:59.551374 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:25:59.552047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:25:59.552335 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:25:59.552614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:25:59.553464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=dd3e6ff060e14b3687689f48ffb99e16) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:25:59.553780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:25:59.555280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96032ad8-bb98-425d-8d3e-dce3ac2abd75 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:25:59.562099 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 442/870] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:25:59 2022] GET /identity/v3/role_assignments?user.id=dd3e6ff060e14b3687689f48ffb99e16&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:00.629536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9adb76-2e5a-4cfc-96c0-cce585939ecc None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.630090 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9adb76-2e5a-4cfc-96c0-cce585939ecc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.630090 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9adb76-2e5a-4cfc-96c0-cce585939ecc None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.631715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 429/871] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:00.637368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91986d5-0964-47fb-a843-ad206100ef74 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.637816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91986d5-0964-47fb-a843-ad206100ef74 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.637916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91986d5-0964-47fb-a843-ad206100ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.655299 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-f91986d5-0964-47fb-a843-ad206100ef74 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:00.656478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-f91986d5-0964-47fb-a843-ad206100ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:00.731771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 443/872] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:00.754097 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9adb76-2e5a-4cfc-96c0-cce585939ecc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:00.775002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:00.866397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9adb76-2e5a-4cfc-96c0-cce585939ecc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:00.902600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:00.903230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:00.903513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:00.903790 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:00.904539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:00.905942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269f7b-5e6e-43fb-b956-c8ac115c9b00 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:00.921706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 430/873] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:00 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:01.285016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04555a02-786a-4ed4-bf2d-9293bb477b26 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.285423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04555a02-786a-4ed4-bf2d-9293bb477b26 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.285619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04555a02-786a-4ed4-bf2d-9293bb477b26 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.287194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 444/874] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:01.292555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97113029-e766-476b-97b5-0cbbd5234057 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.292848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97113029-e766-476b-97b5-0cbbd5234057 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.293135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97113029-e766-476b-97b5-0cbbd5234057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.310908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-97113029-e766-476b-97b5-0cbbd5234057 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:01.312100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-97113029-e766-476b-97b5-0cbbd5234057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:01.397921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 431/875] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:01.422009 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04555a02-786a-4ed4-bf2d-9293bb477b26 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.528892 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04555a02-786a-4ed4-bf2d-9293bb477b26 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.544177 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.550789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89416-ad89-4f2c-9f7b-cad1607f082a None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.551396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89416-ad89-4f2c-9f7b-cad1607f082a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.551789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89416-ad89-4f2c-9f7b-cad1607f082a None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.553507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 432/876] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:01.558634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.559041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.559390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.569230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.570358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.571331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.571814 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.574267 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.577075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:01.578361 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:01.585323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:01.596974 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:01.598188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:01.599273 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:01.602717 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 445/877] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:01.607662 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.670709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 433/878] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:01.687967 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.744017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb1ae8-aa18-4574-acfb-bc06e932f725 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.780677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.781798 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.782309 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.782866 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.783835 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:01.784356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.785965 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.795521 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 446/879] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:01.803913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:01.817107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6de49e-9275-4317-89d9-d6e94f7e5aac None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:01.850998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.861309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:01.862349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.862943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.863442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.864393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:01.866389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad2515-a063-46ea-82c4-96be11b43034 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:01.869286 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:01.894989 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 434/880] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:01 2022] POST /identity/v3/services => generated 269 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:26:01.903357 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f52ee-4765-419e-a844-9eead2d3ec57 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.903930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f52ee-4765-419e-a844-9eead2d3ec57 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.904218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f52ee-4765-419e-a844-9eead2d3ec57 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.906011 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 435/881] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:01.912138 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:01.912434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:01.912740 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:01.941556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:01.943353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:01.943949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2f8e-9410-46fe-b857-8ecb090cab68 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.004387 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.005699 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.005994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.006277 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.022649 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.024670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.033378 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 436/882] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:02.051143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:02.052331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:02.053433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:02.053433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:02.053433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:02.053433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:02.055841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 447/883] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:02.060644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.061882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.176609 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.182082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed83e-64b9-4725-9866-51386cfc8523 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.196668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750a98-a010-4853-94e4-9a58b8382420 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.224122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.225418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.226016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.226513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.227768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.229648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.237787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.238469 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.238799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.239084 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.239828 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:02.240140 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.241513 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.243710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:02.248553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:02.249838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:02.251660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:02.254715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 437/884] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:02.258244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 448/885] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:02.262837 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.265617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.379301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede212a-2193-491b-853d-8a0367f671b2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.379568 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634fbc-8779-4fe7-9938-70bca033238e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.416008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.416711 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.416995 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.417280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.417991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:02.418299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.419265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.419866 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.420759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.421328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.421931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.429886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.430070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 438/886] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:02.431244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.432272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:02.449141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:02.450477 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:02.451697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:02.459162 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 449/887] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:02.460431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.464903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.489660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.540865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f9bce-735d-48ab-85c0-5055e8d6c2e6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.572998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385d9df-2cba-4f01-af41-919f1661700a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.577438 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.578169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.578395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.578674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.579433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:02.579744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.581148 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.587218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 439/888] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:02.614849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.616022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.616552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.617081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.618278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:02.618884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.620625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.646895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 450/889] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:02.648981 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:02.762164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba0936-69ea-4f30-9b34-1b7d7757b837 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:02.786280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:02.806260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:02.806963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:02.807248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:02.807526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:02.879001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:02.880458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:02.988012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 440/890] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:02.994110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.077160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.106456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf2a3-fed8-47fd-b95e-749a32a271bb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.143607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.144422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.144706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.144984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.155747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.157289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-88222dbe-052f-45f6-abcc-9bdd71c16317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:03.175737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:03.177272 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:03.178759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:03.178759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:03.178759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:03.178759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:03.178759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 451/891] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:03.183025 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.201961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.241406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30735-75d9-4810-a56e-8ac177f284d1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.241706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30735-75d9-4810-a56e-8ac177f284d1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.241983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b30735-75d9-4810-a56e-8ac177f284d1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.243855 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 452/892] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:03.249465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.249993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.250509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.271541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:03.273825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:03.290965 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfbd19-db2f-4627-a52f-cd3d5141fff5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.335180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.335850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.336134 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.336411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.337208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:03.337515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.339055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.356440 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 441/893] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.357505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.368553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 453/894] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:03.390826 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.439051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.456978 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.486291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82c6c-da20-468b-acde-689ed01da090 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.501997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4dba-394b-4726-92f1-bcfb025dc72a None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.534595 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ba61-af40-4747-9847-60059464e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.535446 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ba61-af40-4747-9847-60059464e67b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.535736 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ba61-af40-4747-9847-60059464e67b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.536195 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132ba61-af40-4747-9847-60059464e67b None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.545722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.546114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132ba61-af40-4747-9847-60059464e67b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.547131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.547634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132ba61-af40-4747-9847-60059464e67b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.547916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.548400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.549307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.550904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:03.563506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:03.564691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:03.565825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-6132ba61-af40-4747-9847-60059464e67b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:03.566746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:03.567710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:03.568764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:03.570101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 442/895] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:03.570741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ba61-af40-4747-9847-60059464e67b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.572349 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 454/896] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:03.582744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.695677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5f44d-dd02-434e-b543-0558e4ba6b7e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.706048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.708057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132ba61-af40-4747-9847-60059464e67b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.734860 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.735546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.735828 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.736233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.736951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:03.737258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.738627 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.748534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 455/897] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.749344 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.755080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.756069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.756590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.757109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.758120 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:03.759255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.761467 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.775179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:03.779825 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 443/898] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.786013 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.866969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd4d8-5460-47e0-86a1-401ffca20dfd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.925194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.926185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.926739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.927028 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.927755 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:03.928062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.928741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76031f-ef01-4c06-a97a-64184c83e9fe None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:03.929549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.937397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 456/899] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.944808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:03.972593 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:03.973175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:03.973454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:03.973731 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:03.974640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] RBAC: Adding query filter params (role.id=80aeb48c3c264765a77694dd42701cf1, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=8e02c0005bd4418aa02b54f2855f46dd) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:03.975000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:03.976474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:03.982519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 444/900] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/role_assignments?user.id=8e02c0005bd4418aa02b54f2855f46dd&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=80aeb48c3c264765a77694dd42701cf1 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:03.988726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.067966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756c3ed-29d4-4b40-9fb0-86a2348fea30 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.106185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.106896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.107178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.107453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.108262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] RBAC: Adding query filter params (interface=public, service_id=52d34fc7037c4811a34512bd6d98299c, region_id=RegionOne) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.108570 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.109953 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625ddc-3d85-445d-b7b9-5b3bc9bc145d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.116382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 457/901] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:26:03 2022] GET /identity/v3/endpoints?service_id=52d34fc7037c4811a34512bd6d98299c&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:04.121688 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.199757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.222088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265f-b51a-4435-9599-e9ec03d4e10d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.222463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265f-b51a-4435-9599-e9ec03d4e10d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.222868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc265f-b51a-4435-9599-e9ec03d4e10d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.225427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 458/902] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:04.230784 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.231079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.231363 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.245770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689effa1-9566-45dd-a7aa-6bf96bb395ad None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.250750 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:04.251954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:04.288234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.289322 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.290146 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.291260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.291737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.293158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.300691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 445/903] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:26:04.338850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 459/904] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:04.356325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.469406 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553b0d0-9b85-49ed-9f5e-96f6e5729478 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.494854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.506089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.508269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.508269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.508269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.508605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.509793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:04.522896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:04.524057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:04.525360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 446/905] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:04.533225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.571103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.645641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f9c9-3c8f-4228-afe1-7f392fd387be None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.681090 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.681771 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.682061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.682340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.683127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.683437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.684817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.689913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 460/906] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:04.695617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.802214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39211e29-cfe9-4cb0-9500-3abf43e5aca5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:04.842530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:04.843246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:04.843533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:04.843820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:04.844861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:04.845173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:04.846594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e055281-b0af-4ad0-a415-2644ecf3e2f9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:04.852590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 447/907] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:04.858404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:04.960338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:04.970081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893d1d-a814-4805-b7b0-6f84bae5e1ba None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.000096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e533d0-c1a0-44a0-9bf4-d4b2eea60a5f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.000427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e533d0-c1a0-44a0-9bf4-d4b2eea60a5f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.000638 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e533d0-c1a0-44a0-9bf4-d4b2eea60a5f None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.002260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 448/908] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:05.006078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.006803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.007095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.007254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814682-3953-4576-80a7-064a507691b3 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.007432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.007591 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814682-3953-4576-80a7-064a507691b3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.007748 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40814682-3953-4576-80a7-064a507691b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.008173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] RBAC: Adding query filter params (interface=public, service_id=378e664a5f954b228c284554665000b8, region_id=RegionOne) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:05.008485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.010025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.015947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 461/909] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:26:04 2022] GET /identity/v3/endpoints?service_id=378e664a5f954b228c284554665000b8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:05.023681 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.024942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-40814682-3953-4576-80a7-064a507691b3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:05.026110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-40814682-3953-4576-80a7-064a507691b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:05.089986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:05.121553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 449/910] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:05.143489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40814682-3953-4576-80a7-064a507691b3 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:05.152145 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efd36-09f2-47f5-96d6-0f19722b5d6d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.191031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.192152 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.192672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.193244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.194483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.196281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144696b-3faf-4a0a-9b18-aa8ed96d2f0e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.203463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 462/911] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:05 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:26:05.260664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40814682-3953-4576-80a7-064a507691b3 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:05.299187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:05.300292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:05.300793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:05.301274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:05.302270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:05.303999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc227dac-43b0-4486-9a50-0e985b20faae None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:05.330731 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 450/912] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:05 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:26:06.321983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f06fd-4c46-4d3f-9321-33843465cf5b None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.322573 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f06fd-4c46-4d3f-9321-33843465cf5b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.327945 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f06fd-4c46-4d3f-9321-33843465cf5b None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.331723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 463/913] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:06.337166 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda550-5fad-40df-ac81-c80011e8e16e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.337663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda550-5fad-40df-ac81-c80011e8e16e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.337987 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda550-5fad-40df-ac81-c80011e8e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.357031 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d4fda550-5fad-40df-ac81-c80011e8e16e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:06.358255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d4fda550-5fad-40df-ac81-c80011e8e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:06.400093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.443799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 451/914] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:06.466801 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f06fd-4c46-4d3f-9321-33843465cf5b None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.493010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.576867 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f06fd-4c46-4d3f-9321-33843465cf5b None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.580055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6c78-8c8b-41d9-b98f-d34ee11e4e49 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.580350 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6c78-8c8b-41d9-b98f-d34ee11e4e49 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.580631 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6c78-8c8b-41d9-b98f-d34ee11e4e49 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.583478 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 452/915] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:06.587504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.587788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.588062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.618255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:06.619482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:06.623146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.624258 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.624770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.625292 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.636792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:06.645184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:06.646302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:06.647358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:06.650264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 464/916] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:06.656255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.699789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 453/917] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:06.726770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.756291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.778324 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07c74-1ddd-4c5c-b1cd-8bedf0987bd0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.819679 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.820768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.821332 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.821854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.822857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:06.823455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.825110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.831900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:06.835630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b870d-5ad3-49a5-a664-4d397bfc6ac4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:06.839240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 465/918] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:06.842524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.879571 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:06.880548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:06.880828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:06.881103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:06.882071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:06.883793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:06.904363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:06.905661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 20:26:06.906715 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:06.910674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 454/919] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:06.912459 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:06.963748 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fc1e7-f476-4011-abf8-610b66b233a1 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.009931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.010793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.011076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.011352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.025753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.027423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.031005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.040516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51192bc-0cff-41c2-a733-465e4bfa8690 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:07.050189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:07.051372 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:07.052552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:07.052552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:07.052552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:07.052552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:07.054773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 466/920] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:07.059088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.088177 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.088779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.089065 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.089344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.090355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:07.090667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.092268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.102767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 455/921] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:07.107700 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.143133 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.178257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd55abe-c1e8-4fcc-834b-00b7c366ead9 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.227101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.227968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.228251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.228665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.229422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:07.229739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.232032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.233433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc356fa8-3ba1-49f9-afe9-70bfb49a1a7c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.250773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 467/922] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:07.253830 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.278191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.279413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.280036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.280543 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.281494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:07.282050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.283888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.290601 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 456/923] 10.222.0.77 () {56 vars in 1114 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:07.297695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.341044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.389727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284173f0-0ecf-4f40-8bcc-dcf1640d8d69 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.416112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.426626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.427686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.427976 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.428257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.429262 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c613-10f6-4b49-ab08-eb5b8131743f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.436522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.438368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:07.454913 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:07.456151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:07.462843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 468/924] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:07.466007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.479512 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.480306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.480663 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.481018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.482226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.484554 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a7e68-134b-4b29-83b5-4afee3f4cafe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.506079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 457/925] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:07.507822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017c7f1-6574-4877-b536-ea6728d39598 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.508115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017c7f1-6574-4877-b536-ea6728d39598 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.508395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017c7f1-6574-4877-b536-ea6728d39598 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.509894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 458/926] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:07.515915 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1cfd9-f4df-4fb7-b9a1-65e60621a702 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.516196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1cfd9-f4df-4fb7-b9a1-65e60621a702 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.516480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1cfd9-f4df-4fb7-b9a1-65e60621a702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.535600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-4ac1cfd9-f4df-4fb7-b9a1-65e60621a702 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:07.536955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-4ac1cfd9-f4df-4fb7-b9a1-65e60621a702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:07.612155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481e3fd-3d10-4339-b002-9dc76d118681 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.631791 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 459/927] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:07.635652 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.637187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc48a-e007-4ced-b961-0b1673ba5a96 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.637476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc48a-e007-4ced-b961-0b1673ba5a96 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.637756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc48a-e007-4ced-b961-0b1673ba5a96 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.639536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 460/928] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:07.647204 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.647652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.647999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.665358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.666057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.666340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.666619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.667551 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:07.667863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.669350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.670347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:07.671776 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:07.690553 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 469/929] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:07.691466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.757436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 461/930] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:07.758144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.767143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.807171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6a85-1169-4a54-bcee-8ccf34595a87 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.844697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.845524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.845808 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.846084 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.846782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.848168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:07.860887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:07.861999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:07.863096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 470/931] 10.222.0.77 () {56 vars in 1132 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:07.864118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.879067 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fe6dc-6c65-4954-abe7-d8507082a1e7 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:07.908495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:07.915650 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:07.916471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:07.916757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:07.917037 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:07.927621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:07.929110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:07.946785 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:07.947869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:07.949029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:07.949029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:07.949029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:07.949029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:07.951122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 462/932] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:07.952737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:07.978057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a8590-e896-4360-989a-ce65e095bb55 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.017331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.018172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.018507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.018760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.019384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.019856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.020764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:08.036847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:08.038062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:08.044696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 471/933] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:08.045670 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.066941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea743a08-90a0-409d-9178-67e2f9904d22 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.109804 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.110488 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.110797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.111079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.112056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.112375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.114725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.125627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 463/934] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.125627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.147996 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5c9a-c2a2-4398-8b3d-c7048919c55f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.149807 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.186885 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.187554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.187834 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.188109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.188834 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.189137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.190507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.202834 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 472/935] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.203617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.243634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b450d-f46c-46d4-ba69-3c69c84467ae None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.271702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.292279 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.292947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.293224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.293606 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.294319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.294635 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.297155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.306298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 464/936] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.307971 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.338192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39156a6-cb78-47f8-8821-dd61d8f34d35 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.389567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.390262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.390537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.390845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.391575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.391884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.393267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.406079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 473/937] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.406957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.446030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.450956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2678b-3483-4e4a-9a21-3b3ed1dc912f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.486953 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.487950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.488301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.488684 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.498642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.500160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:08.518445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:08.519798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:08.521117 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:08.523095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 465/938] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:08.524019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.529832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110447f-2d16-4c1d-b851-f56e9b298312 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.571133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.572845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.573131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.573409 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.574142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.574452 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.576062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.579634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.589969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 474/939] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.590828 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.658171 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221d00-1219-4d1c-9d44-218680d9c6eb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.693102 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.703642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.704466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.704818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.705162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.705988 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.707697 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.710253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4eb159-2255-40d9-a374-6c6df588e719 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.743056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 466/940] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:08.744587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.766483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.767545 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.767686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.767892 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.768767 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.769086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.770602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.785022 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 475/941] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.791077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.857767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:08.863081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2279c7-af86-4d70-8c54-37c07b099dd9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.901809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.902659 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.903074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.903498 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.904415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] RBAC: Adding query filter params (interface=public, service_id=d857565f7d374b69bea93c9fb7f4a411, region_id=RegionOne) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:08.904839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.906376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.917859 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfe6ca-01d3-49e1-a419-89712907c1af None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:08.919734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 467/942] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/endpoints?service_id=d857565f7d374b69bea93c9fb7f4a411&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:08.920797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:08.957917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:08.960118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:08.960118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:08.960118 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/8e02c0005bd4418aa02b54f2855f46dd/roles/80aeb48c3c264765a77694dd42701cf1` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:08.964016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=8e02c0005bd4418aa02b54f2855f46dd, role_id=80aeb48c3c264765a77694dd42701cf1)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:08.965483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de92f45-effb-483f-aed5-a747fbcdf7e8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:08.981548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 476/943] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:26:08 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/8e02c0005bd4418aa02b54f2855f46dd/roles/80aeb48c3c264765a77694dd42701cf1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:26:09.042748 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744450e-9068-4d3d-af09-389fb24c51aa None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:09.082083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:09.082805 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:09.083088 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:09.083362 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:09.084192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:09.085718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79a524-cc41-4fbd-923e-e31f0e4906c0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:09.094261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 468/944] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:08 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:26:09.838384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f57e-6e3f-44be-a129-5a3895116d9d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:09.839489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f57e-6e3f-44be-a129-5a3895116d9d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:09.840025 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8f57e-6e3f-44be-a129-5a3895116d9d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:09.841897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 477/945] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:09.847944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:09.848791 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:09.849289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:09.867367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:09.869085 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:09.890879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:09.941843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 469/946] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:09.966544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8f57e-6e3f-44be-a129-5a3895116d9d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:09.977110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.084370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8f57e-6e3f-44be-a129-5a3895116d9d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.120281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.121334 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.121853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.122356 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.123362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.125067 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.126795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: WARNING keystone.server.flask.common [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:26:10.148842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.sql.core [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:26:10.148842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:26:10.148842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [parameters: {'id': '8a55d8032b9640dc846011c4ed3fcaa7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:26:10.148842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a55d8032b9640dc846011c4ed3fcaa7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a55d8032b9640dc846011c4ed3fcaa7. May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application conn.query(q) May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:26:10.166968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application result.read() May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 20:26:10.174740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application next(self.gen) May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application yield resource May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application next(self.gen) May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise self.value May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application session.commit() May 19 20:26:10.175946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self.session.flush() May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application compat.raise_( May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:26:10.177060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:26:10.178154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application conn.query(q) May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application result.read() May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:26:10.179195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [parameters: {'id': '8a55d8032b9640dc846011c4ed3fcaa7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:10.180256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:10.181264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8a55d8032b9640dc846011c4ed3fcaa7. May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:10.182367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 478/947] 10.222.0.77 () {60 vars in 1140 bytes} [Thu May 19 20:26:09 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:10.188263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.295752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cf889-8401-4e08-8549-aea66e514d6e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.331268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.332617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.332831 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.333071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.340631 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.342132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-5edc00c6-2245-4fa9-9f29-c742303a64fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:10.356778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:10.357862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:10.359380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 470/948] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:10.364632 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:10.432402 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:10.474283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cf95-b8d6-4c54-be5f-c9b5b3189889 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:10.508947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:10.509626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:10.509916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:10.510196 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:10.511013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:10.511325 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:10.512985 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2df326-aace-46d8-b990-ef55d260fb61 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:10.534012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 479/949] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:11.124247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b02af-7dbd-4955-b2b5-a0c15f6390e0 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.124993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b02af-7dbd-4955-b2b5-a0c15f6390e0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.124993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b02af-7dbd-4955-b2b5-a0c15f6390e0 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.126402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 471/950] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:11.131891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1160b2-a94f-4b3c-ad9a-31b705b5fa02 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.132403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1160b2-a94f-4b3c-ad9a-31b705b5fa02 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.132569 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1160b2-a94f-4b3c-ad9a-31b705b5fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.150250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0a1160b2-a94f-4b3c-ad9a-31b705b5fa02 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:11.151800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0a1160b2-a94f-4b3c-ad9a-31b705b5fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:11.228811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 480/951] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:11.250618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b02af-7dbd-4955-b2b5-a0c15f6390e0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.270053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.276598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5c8e-0958-4ec1-8cbc-cec2f3a3ed1e None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.276896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5c8e-0958-4ec1-8cbc-cec2f3a3ed1e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.277181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce5c8e-0958-4ec1-8cbc-cec2f3a3ed1e None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.278741 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 481/952] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:11.285493 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.285942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.286233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.307722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:11.309096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:11.364080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b02af-7dbd-4955-b2b5-a0c15f6390e0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.379206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.390987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 482/953] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:11.400819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.401746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.402122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.402493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.403307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.404799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.407952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c14c9780-cff6-460a-81e5-1a04fb844e3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:11.417887 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:11.419213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:11.420230 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 472/954] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:11.421216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647bdcb-9a42-494d-a491-6efe307bc990 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.421216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647bdcb-9a42-494d-a491-6efe307bc990 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.421216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647bdcb-9a42-494d-a491-6efe307bc990 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.422597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 473/955] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:11.428484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.428770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.429048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.446896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:11.448082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:11.511033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1eff6-1a71-4801-9e02-585c49c593ab None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.530779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 474/956] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:11.530779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.546328 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.547482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.549147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.549463 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.549657 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.562240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:11.570441 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:11.571758 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:11.572951 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:11.576510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 483/957] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:11.577337 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.620157 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.645603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5fd9-ada6-487c-97bd-e7c647275ad7 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.681294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32558f0f-3ab0-4a75-b251-0c7fb8a6c250 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.681526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.682001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.682284 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.682555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.683314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:11.683623 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.685026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.689963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 475/958] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:11.690566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.721432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.722268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.722546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.722853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.723526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.724943 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:11.738501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:11.739825 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:11.740853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 484/959] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:11.741812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.776047 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.804476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b63f6-3e52-4bf9-8c5c-c6f4e5eb60e9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.843066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.843722 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.844307 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.844585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.845330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:11.845651 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.847069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.853970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f9f0-1778-4d4a-9aff-92f25f45a39e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:11.862626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 476/960] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:11.862626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:11.862961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:11.890199 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:11.891002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:11.891287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:11.891820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:11.892523 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:11.892708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:11.894167 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:11.906992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 485/961] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:11.906992 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.002921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a288d4-bc5f-4fb2-ac97-5c9efeecc56e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.031962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97102e1-589e-47bf-87dd-7a89beedd7e6 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.051783 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.053019 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.053597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.053889 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.054635 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:12.055341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.057270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.059858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.065600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 477/962] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:12.074103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.082851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.083884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.084229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.084598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.097187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.098796 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:12.120540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:12.121714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:12.122836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:12.122836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:12.122836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:12.122836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:12.122836 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 486/963] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:12.129095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.159220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.216679 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5289ad-fc6e-469d-9c1d-0272f0d9a1bd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.239886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687f3f7-4341-4098-bed5-8e1172ddc135 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.268160 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.269395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.270274 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.270747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.271934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:12.272667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.275051 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.278775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.279489 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.279865 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.280240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.281068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:12.281472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.282061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 478/964] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:12.286737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.290282 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.300186 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 487/965] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:12.306806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.363539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.416950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a806c-e622-468f-a289-5e82c002a8fe None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.418317 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.440549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68b41-e17a-4cd5-9156-4d61a780489b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.462757 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.464049 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.464548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.465170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.466443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.468687 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.477072 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.478049 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.478418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.478807 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.487261 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.488972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.496314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 479/966] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:12.516552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:12.517749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 20:26:12.518923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:12.521970 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 488/967] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:26:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:12.528188 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.653074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f3ee-2b5c-44b8-b71b-9689d1fdcfa7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.674410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.696057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.696952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.697521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.697802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.698653 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:12.698993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.700464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07bdd7-aa88-4d3e-8ead-4f7967ade31e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.721876 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 480/968] 10.222.0.77 () {56 vars in 1149 bytes} [Thu May 19 20:26:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:12.727866 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:12.835231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceef04-0c8f-427c-940f-b8b87f7ed193 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:12.856409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b853-c70b-4f34-afa6-7f925de775b3 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.856764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b853-c70b-4f34-afa6-7f925de775b3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.856964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5b853-c70b-4f34-afa6-7f925de775b3 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.858486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 481/969] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:12.863894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.864176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.864447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.877886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:12.878544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:12.878861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:12.879132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:12.886111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:12.887661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:12.892530 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:12.952036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:12.953408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:12.990710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 482/970] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:13.012929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.082238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 489/971] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:12 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:13.087773 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.120803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b4c25-dba0-4b92-baf7-bc4c5d9a4914 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.124144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.145883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.158318 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.159245 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.159398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.159585 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.160288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.161760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.163099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: WARNING keystone.server.flask.common [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 20:26:13.177036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.sql.core [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:26:13.177036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:26:13.177036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [parameters: {'user_id': '1ff1b970a0af4d278af24909924011f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:26:13.177036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=270826) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application conn.query(q) May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result.read() May 19 20:26:13.185999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:26:13.187212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application next(self.gen) May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application yield resource May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application next(self.gen) May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.session.rollback() May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.force_reraise() May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise self.value May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application session.commit() May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 20:26:13.193386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._prepare_impl() May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.session.flush() May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._flush(objects) May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application compat.raise_( May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application flush_context.execute() May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rec.execute(self) May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 20:26:13.194436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 20:26:13.195569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result = self._query(query) May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application conn.query(q) May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application result.read() May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 20:26:13.197436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [parameters: {'user_id': '1ff1b970a0af4d278af24909924011f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:13.200235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 20:26:13.202720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 483/972] 10.222.0.77 () {60 vars in 1131 bytes} [Thu May 19 20:26:13 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:13.205288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.225358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33cada-4f02-4f0c-a91d-d2e9d71b2ef2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.265839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.266953 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.267238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.267538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.281524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.283170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:13.305624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:13.308135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:13.309235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:13.309235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:13.309235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:13.309235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:13.309235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 490/973] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:13.314370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.338223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7bdc1-faea-47e2-b2bd-86a4dbca2e7e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.387868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.389558 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.390301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.390886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.402633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.405550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:13.424968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:13.426214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 20:26:13.427396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:13.435012 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 484/974] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:13.437929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.452619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.461379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200089-4a21-4738-9fc2-8aa0ce553c42 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.479484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.504220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.505303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.505849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.506337 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.507323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:13.507843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.509668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.523155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 491/975] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.530123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.569638 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60018b0-526f-4279-9f60-fa066cf36e70 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.607168 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.607876 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.608161 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.608576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.609548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:13.609861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.612074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.657751 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a29a60-3a62-4b6a-a061-7d09a064c105 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.663434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 485/976] 10.222.0.77 () {56 vars in 1101 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:13.701214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.702323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.702883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.703325 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.712081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.713805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:13.730561 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:13.732036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:13.733364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:13.735963 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 492/977] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:13.742415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.841354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:13.859548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eea0d5-7e93-4226-a929-2f2eaea7aeaf None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:13.898332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:13.899492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:13.899972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:13.900423 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:13.901455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:13.901987 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:13.903746 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2aa1-f764-4baa-91f3-926487387ef1 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:13.917064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 486/978] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:13.923235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:13.941370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:14.035478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8cd1-8d94-47f9-8e50-57a356694f92 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:14.076400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:14.077257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.077636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.078012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.079015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] RBAC: Adding query filter params (role.id=80aeb48c3c264765a77694dd42701cf1, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=8e02c0005bd4418aa02b54f2855f46dd) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:14.079457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:14.081040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc7f2d-7593-4f93-b8be-452bf58bd733 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:14.088329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 493/979] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:13 2022] GET /identity/v3/role_assignments?user.id=8e02c0005bd4418aa02b54f2855f46dd&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=80aeb48c3c264765a77694dd42701cf1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:14.248247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d2af-c365-45a3-ae6c-4271b78b6e8c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.248484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d2af-c365-45a3-ae6c-4271b78b6e8c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.248804 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d2af-c365-45a3-ae6c-4271b78b6e8c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.250386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 487/980] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:14.256075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdd4a-7d55-48f5-b42c-e42517ff7989 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.256635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdd4a-7d55-48f5-b42c-e42517ff7989 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.256635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bdd4a-7d55-48f5-b42c-e42517ff7989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.274733 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-9d6bdd4a-7d55-48f5-b42c-e42517ff7989 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:14.275886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-9d6bdd4a-7d55-48f5-b42c-e42517ff7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:14.350137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 494/981] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:14.373256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d2af-c365-45a3-ae6c-4271b78b6e8c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:14.481386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d2af-c365-45a3-ae6c-4271b78b6e8c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:14.516115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:14.516940 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.517346 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.517729 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.518565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:14.520092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5eca9-9e72-4ca8-b149-c2e216a93edd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:14.535759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 488/982] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:14 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:14.874979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3b5b-5269-49c7-8fd2-9dd9f68b4e7f None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.875270 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3b5b-5269-49c7-8fd2-9dd9f68b4e7f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.875549 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c3b5b-5269-49c7-8fd2-9dd9f68b4e7f None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.877088 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 495/983] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:14.882591 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:14.882888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:14.883206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:14.889590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:14.903347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:14.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:14.981798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 489/984] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:15.004179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c3b5b-5269-49c7-8fd2-9dd9f68b4e7f None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:15.015528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:15.112978 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c3b5b-5269-49c7-8fd2-9dd9f68b4e7f None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:15.152144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:15.152144 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:15.154447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:15.154447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:15.154447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:15.154734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:15.168891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:15.170185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:15.171226 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:15.172772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 496/985] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:15.176341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:15.283596 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a25f1d-b4de-460c-8d6d-73329f5571a4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:15.312795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:15.320324 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:15.321052 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:15.321336 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:15.321618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:15.322349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:15.322658 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:15.325905 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:15.332200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 490/986] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:15.337923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:15.417557 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:15.453340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37e81-939c-4ce5-b699-57edf700b0cd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:15.490193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:15.490906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:15.491190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:15.491470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:15.492215 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:15.492524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:15.493986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:15.499135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 497/987] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:15.504927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:15.604642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57edf6c-27c8-4c8c-a2c8-1de3d075baee None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:15.639928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:15.640597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:15.640862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:15.641162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:15.641958 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] RBAC: Adding query filter params (interface=admin, service_id=d857565f7d374b69bea93c9fb7f4a411, region_id=RegionOne) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:15.642272 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:15.643702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6e97-ee05-4dd0-ac83-0758235d8057 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:15.649561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 491/988] 10.222.0.77 () {56 vars in 1249 bytes} [Thu May 19 20:26:15 2022] GET /identity/v3/endpoints?service_id=d857565f7d374b69bea93c9fb7f4a411&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:15.655079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:15.767975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ea7b7-24d7-422b-9481-3d7e75657423 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:15.804119 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:15.804800 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:15.805058 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:15.805419 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:15.806110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:15.807534 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c363710-3273-4949-9ea1-145ef4f6526d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:15.809536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:15.815179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 498/989] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:15 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 20:26:16.348038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c529a-eaac-4cdc-9b1d-f4edc5792cf0 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.348376 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c529a-eaac-4cdc-9b1d-f4edc5792cf0 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.348611 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c529a-eaac-4cdc-9b1d-f4edc5792cf0 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.350016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 492/990] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:16.355537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.356006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.356114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.373540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:16.374749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:16.451238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 499/991] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:16.474037 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c529a-eaac-4cdc-9b1d-f4edc5792cf0 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.537442 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.583796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c529a-eaac-4cdc-9b1d-f4edc5792cf0 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.619491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.620330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.620608 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.620886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] PATH_INFO: `/v3/services/image` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.621551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.623056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:16.635886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:16.637338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:16.638366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:16.640299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 493/992] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:16.643764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.746594 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a0ff-876a-4993-abf7-d787df9fd099 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.776875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.784046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.785006 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.785456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.785900 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.786851 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] RBAC: Adding query filter params (name=image) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:16.787345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.788891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038820a5-1482-4618-814a-a688715d72c0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:16.794654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 500/993] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:16.800452 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.815087 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa0b0-4c6e-48b3-ae91-bdd6c612adc1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.815391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa0b0-4c6e-48b3-ae91-bdd6c612adc1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.815699 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aa0b0-4c6e-48b3-ae91-bdd6c612adc1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.817205 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 501/994] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:16.822141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.822440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.822717 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.839367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:16.841100 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:16.913105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b6699-749d-4c0a-926f-fbb72ace8714 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:16.914092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 502/995] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:16.937206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:16.941626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:16.954223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:16.954931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:16.955216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:16.955494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:16.956220 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:16.956528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:16.957941 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:16.963333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 494/996] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:17.053034 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7873847-e645-4fe8-82b3-c18dd0af3d00 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.079342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:17.092050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.092782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.093060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.093347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] PATH_INFO: `/v3/services/compute` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.094343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.095792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:17.108840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:17.110101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:17.111856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 503/997] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:17.116214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.226399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d99c9-7b00-4721-9e12-919becaec6e2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.261131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.261801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.262155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.262441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.263189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] RBAC: Adding query filter params (name=compute) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:17.263499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.264911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.270163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 495/998] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:17.275833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.387695 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb90de-0fe6-4c32-b67f-ce73dea80daf None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.422157 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.422873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.423159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.423439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.424149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:17.424448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.425823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.431171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 504/999] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:17.436836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.490714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:17.544798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125fb5-30a2-49ed-aeec-61cbf7aef250 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.581295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.581964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.582246 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.582526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.583355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] RBAC: Adding query filter params (interface=public, service_id=cd8ec84004c64bb689f1972a00df01f2, region_id=RegionOne) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:17.583671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.585076 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd01731-00c1-46d8-8214-5dd08ebdf117 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.595573 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 496/1000] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/endpoints?service_id=cd8ec84004c64bb689f1972a00df01f2&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:17.596598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:17.651462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:17.702063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d623-1155-4f14-968d-9c596ac8bfc6 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:17.737093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:17.737768 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:17.738050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:17.738331 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:17.739059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:17.740425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf253-a7d6-4868-872f-9baa736d7924 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:17.747442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 505/1001] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:17 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:26:18.056819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485585-dbb4-4dcc-877f-b41b717cafdc None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.057126 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485585-dbb4-4dcc-877f-b41b717cafdc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.057415 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9485585-dbb4-4dcc-877f-b41b717cafdc None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.058646 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 497/1002] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:18.065904 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.066198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.066481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.083584 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:18.084762 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:18.157714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 506/1003] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:18.180762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9485585-dbb4-4dcc-877f-b41b717cafdc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:18.292721 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9485585-dbb4-4dcc-877f-b41b717cafdc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:18.307186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:18.336919 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:18.337739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.338030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.338268 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.338999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:18.340403 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:18.353007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:18.354210 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 20:26:18.355617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:18.359027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 498/1004] 10.222.0.77 () {56 vars in 1126 bytes} [Thu May 19 20:26:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:18.360329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:18.406302 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:18.461610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79b21e-a1a3-4e67-9bfb-04cd2a519752 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:18.496626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:18.497298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.497583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.497855 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.499092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:18.499402 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:18.501454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:18.506957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 507/1005] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:18.512586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:18.616375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8fd31-c05f-4680-869d-e76d5325f811 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:18.650242 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:18.650950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.651234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.651509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.652222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:18.652515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:18.653937 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cabbd-1e36-4c93-90a4-1fc723860138 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:18.659075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 499/1006] 10.222.0.77 () {56 vars in 1122 bytes} [Thu May 19 20:26:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:18.664683 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:18.767362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67612ad-a748-4e14-ada1-95c0185681eb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:18.778605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:18.803431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:18.804096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:18.804375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:18.804636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:18.805476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:18.806878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9cb46b-d484-4f1f-b1bf-c2b1a628e98c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:18.830723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 508/1007] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:19.245568 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48724f3b-4c0c-4cec-b067-2855e9458d7f None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.245845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48724f3b-4c0c-4cec-b067-2855e9458d7f None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.246155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48724f3b-4c0c-4cec-b067-2855e9458d7f None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.247513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 500/1008] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:19.253268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc33b3-7e3d-4bf2-b2a7-0305e557b369 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.253527 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc33b3-7e3d-4bf2-b2a7-0305e557b369 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.253843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc33b3-7e3d-4bf2-b2a7-0305e557b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.271525 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b9dc33b3-7e3d-4bf2-b2a7-0305e557b369 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:19.272719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b9dc33b3-7e3d-4bf2-b2a7-0305e557b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:19.352409 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 509/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:19.374599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48724f3b-4c0c-4cec-b067-2855e9458d7f None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:19.420468 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:19.481437 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48724f3b-4c0c-4cec-b067-2855e9458d7f None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:19.521507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:19.522066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:19.522335 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:19.522622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:19.523413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:19.524897 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bba1c-f058-431f-9fb1-b2c4a7fccf19 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:19.541492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 501/1010] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:19 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 20:26:20.005317 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec65d-3ea0-4c2c-827f-e0d1737fbe92 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.005942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec65d-3ea0-4c2c-827f-e0d1737fbe92 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.005942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec65d-3ea0-4c2c-827f-e0d1737fbe92 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.007261 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 510/1011] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:20.012997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187141-31b5-497f-a723-0ae011486396 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.013470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187141-31b5-497f-a723-0ae011486396 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.013561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be187141-31b5-497f-a723-0ae011486396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.031158 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-be187141-31b5-497f-a723-0ae011486396 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:20.032342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-be187141-31b5-497f-a723-0ae011486396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:20.110381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 502/1012] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:20 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:20.134138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ec65d-3ea0-4c2c-827f-e0d1737fbe92 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:20.239178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:20.248166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ec65d-3ea0-4c2c-827f-e0d1737fbe92 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:20.283746 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:20.284462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.284749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.285021 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] PATH_INFO: `/v3/services/compute` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.285675 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:20.287070 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:20.299045 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:20.300255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:20.301290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 511/1013] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:20.306424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187141-31b5-497f-a723-0ae011486396 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:20.335069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:20.410931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be187141-31b5-497f-a723-0ae011486396 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:20.445997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:20.446664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.446973 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.447252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.447963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:20.448273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:20.449680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:20.455017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 503/1014] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:20.460480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:20.564538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7b060-5660-4366-9686-583ae3c2cabc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:20.600638 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:20.601312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.601598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.601843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.602611 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] RBAC: Adding query filter params (type=compute) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:20.602949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:20.604329 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434fe23-4928-4045-b0a3-a652b3dbf04a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:20.609962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 512/1015] 10.222.0.77 () {56 vars in 1112 bytes} [Thu May 19 20:26:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:20.615538 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:20.710436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:20.720718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8ad75-fa53-4d8f-b2c2-cab525ad0e30 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:20.757269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:20.757943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:20.758295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:20.758576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:20.759369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:20.760788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161602-6c18-4d98-83ba-fd90535310e7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:20.780630 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 504/1016] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:21.103017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec83e-5f0a-470e-8bd1-b2faa2e34cf4 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.103614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec83e-5f0a-470e-8bd1-b2faa2e34cf4 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.103614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ec83e-5f0a-470e-8bd1-b2faa2e34cf4 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.105114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 513/1017] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:21.110641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.111110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.111224 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.129263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:21.130439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:21.220926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 505/1018] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:21.244291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec83e-5f0a-470e-8bd1-b2faa2e34cf4 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:21.271782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:21.357425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ec83e-5f0a-470e-8bd1-b2faa2e34cf4 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:21.392429 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:21.395294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.395294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.395294 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.396023 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:21.397482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9912b-74d2-4d0a-96bc-8e416a6d1111 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:21.399422 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 514/1019] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:21.405540 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:21.485363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:21.513710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038146a-45e8-4437-aef2-c28e829d3630 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:21.548075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:21.548742 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.549020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.549294 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.550003 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:21.551495 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cae27-478d-4ef5-820d-e3f64f47d682 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:21.586708 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 506/1020] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:21 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:21.804280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae924-bf4a-49a3-8bf9-592bf13965f2 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.804567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae924-bf4a-49a3-8bf9-592bf13965f2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.804850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ae924-bf4a-49a3-8bf9-592bf13965f2 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.806313 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 515/1021] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:21.811842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:21.812148 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:21.812445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:21.830050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:21.831289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:21.901618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 507/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:21.924114 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ae924-bf4a-49a3-8bf9-592bf13965f2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.022593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.034644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ae924-bf4a-49a3-8bf9-592bf13965f2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.069378 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.070106 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.070390 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.070712 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] PATH_INFO: `/v3/services/image` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.071392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.072744 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:22.084532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:22.085910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:22.087007 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:22.091706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 516/1023] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:26:21 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:22.097641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.163631 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.210949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5919f4-9d88-41f4-a67f-41687c977157 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.247289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.247957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.248197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.248501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.249208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] RBAC: Adding query filter params (name=image) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:22.249524 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.250931 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.256249 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 508/1024] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:22.262020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.374165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418d3e7-9a34-4d52-af4b-7d89a9b17986 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.410187 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.410897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.411190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.411459 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.412244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:22.412555 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.413966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.419421 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 517/1025] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:22.425266 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.528707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadaf87a-de72-4af2-8fdd-c8590f92c68c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.551614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.567526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.568191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.568471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.568741 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.569535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] RBAC: Adding query filter params (interface=public, service_id=85e806b6d4a54634a1ff1276c8bf2a40, region_id=RegionOne) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:22.569842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.571289 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26332e-b71e-43c8-a20f-c81f4c97a641 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.576584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 509/1026] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:26:22 2022] GET /identity/v3/endpoints?service_id=85e806b6d4a54634a1ff1276c8bf2a40&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:22.582060 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:22.606357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:22.685843 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2306-9879-4057-871b-0c6dfa3b79b7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:22.721983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:22.722713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:22.723014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:22.723298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:22.723994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:22.725355 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36539e1-7ca2-41aa-b431-69a3e76c8eef None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:22.732284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 518/1027] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:26:22 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:26:23.140201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d3a8-2ace-4697-a940-895c755f2bfa None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.140484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d3a8-2ace-4697-a940-895c755f2bfa None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.140784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435d3a8-2ace-4697-a940-895c755f2bfa None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.142298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 510/1028] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:23.147517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.147779 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.148304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.165982 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:23.167195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:23.238720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 519/1029] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:23.262441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435d3a8-2ace-4697-a940-895c755f2bfa None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:23.377813 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435d3a8-2ace-4697-a940-895c755f2bfa None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:23.413560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:23.414340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.414626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.414943 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.425539 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:23.433781 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:23.434948 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:23.435990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:23.439062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 511/1030] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:23.441084 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:23.457697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:23.551730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f34fc-9d98-4274-9bba-12c5e1bd64db None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:23.588093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:23.588779 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.589035 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.589338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.590101 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:23.590465 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:23.591842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:23.605391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 520/1031] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:23.606779 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:23.656883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:23.719366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870a92-28be-4a07-9b22-3aae0dc485a2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:23.755115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:23.755917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.756200 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.756462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.767458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:23.768938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-57f0a633-b6ce-43dd-8df0-a4fddd178cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:23.786192 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:23.787312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:23.788493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:23.788493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:23.788493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:23.788493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:23.791110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 512/1032] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:23.793405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:23.869023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7ead-57fd-403d-9076-ec4047cc1678 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.869280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7ead-57fd-403d-9076-ec4047cc1678 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.869566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e7ead-57fd-403d-9076-ec4047cc1678 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.871112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 513/1033] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:23.875952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.876251 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.876525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.882994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:23.896439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:23.898111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:23.922249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2c10f-8d38-4f38-a814-981cc71f07f7 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:23.972841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 514/1034] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:23.973926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:23.974607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:23.974916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:23.975191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:23.975916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:23.976221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:23.977703 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:23.991795 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 521/1035] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:23.997462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:23.997624 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.026910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.103854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb80d5b-e22b-4270-a9e9-61896dbee18c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.108515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e4750-1f87-4355-be4e-9c1afec43b63 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.149353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.150297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.150588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.150900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] PATH_INFO: `/v3/users/nova` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.151212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.152018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.152307 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.152576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.153818 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.155308 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.157116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 522/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:24.160738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.162199 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.162719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.167155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:24.177992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:24.179191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:24.180578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 515/1037] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:26:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:24.185103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.278856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.279671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d562d4-20a4-44dd-af79-03b0fba02b80 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.295078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66daf9-9eff-439a-aad3-44f4f52e2023 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.316509 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.317267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.317617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.317966 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.318780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.320392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.339682 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.340373 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.340679 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.340942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.341798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:24.342114 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.343607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.344457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 523/1038] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:26:24 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:24.372220 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 516/1039] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:26:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:24.378095 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.446310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.496300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0ee86-c685-41aa-87ca-b50f1347d6ad None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.534113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.534719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.535030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.535293 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.607367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.608832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.667542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.711297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 524/1040] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:24.716960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.828568 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5db0b-8e74-4a27-a221-21701273a367 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:24.864015 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:24.864827 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.865105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.865379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.875926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:24.877417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:24.880052 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4da0e7fc-1b4d-4661-aba2-e982903c03cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:24.896848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:24.898409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:24.899944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:24.899944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:24.899944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:24.899944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:24.902777 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 517/1041] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:24.904231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:24.952563 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1268-2715-4cf0-b252-22abf783ff6a None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.952811 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1268-2715-4cf0-b252-22abf783ff6a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.953096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a1268-2715-4cf0-b252-22abf783ff6a None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.954486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 518/1042] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:24.959464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:24.959743 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:24.960020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:24.980997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:24.982218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:25.010781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f0a4-8570-49ab-918d-959df12cf004 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.046289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.047089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.047439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.047778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.048574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.048955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.050405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.056780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 519/1043] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:25.067079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 525/1044] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.067910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.081184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.104435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.175690 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae343aa-8502-4763-bae0-ef9920d36068 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.186240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88bd-7772-4ff4-a97c-5e6a5b7d7a1e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.203247 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.214339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.215255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.215549 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.215812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.222431 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.223274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.223563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.223739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.223861 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] PATH_INFO: `/v3/services/image` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.224503 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.225255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.225876 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:25.237763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:25.238987 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:25.240056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 526/1045] 10.222.0.77 () {56 vars in 1105 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:25.243819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:25.245079 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:25.246201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 520/1046] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:25.246833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.251153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.345872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.364711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384186f9-7dbc-4e53-a672-19a69ab12326 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.366562 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8c12-3c30-4fa5-8083-0b3da3a566b2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.402870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.403558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.403844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.404127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.404846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] RBAC: Adding query filter params (name=image) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.405170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.406592 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.408004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.408647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.408927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.409227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.409998 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.410333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.417602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 527/1047] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.418155 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.418858 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.431487 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 521/1048] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.437397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.487327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.525706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ecd37-9c89-4e9e-8915-f2835119af17 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.544725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e8723-8b1a-413e-bd30-79018035ea6d None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.564928 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.565877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.566163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.566447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.567207 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] RBAC: Adding query filter params (type=image) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.567516 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.569315 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.579426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 528/1049] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:25.580443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:25.587882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.588671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.589061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.589451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.590414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] RBAC: Adding query filter params (role.id=80aeb48c3c264765a77694dd42701cf1, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:25.590863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.592448 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878d3a5-db19-4517-b411-643f430dd0ed None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.597368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:25.599879 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 522/1050] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:25 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=80aeb48c3c264765a77694dd42701cf1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:25.702711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2484f-9f07-4854-973f-f05a077c2040 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:25.745522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:25.746346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:25.746629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:25.746955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:25.748260 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:25.749691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c22c3-b061-46d8-bb3b-f53209216ac3 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:25.776163 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 529/1051] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:26:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:26.649410 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fd44-afce-4960-b587-c14df7939329 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.650005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fd44-afce-4960-b587-c14df7939329 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.650005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291fd44-afce-4960-b587-c14df7939329 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.651370 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 523/1052] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:26.657405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.657850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.657937 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.675450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:26.676631 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:26.746575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:26.766982 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 530/1053] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:26.782211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291fd44-afce-4960-b587-c14df7939329 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:26.894924 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291fd44-afce-4960-b587-c14df7939329 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:26.908557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:26.934864 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:26.935669 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:26.935950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:26.936219 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:26.947257 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:26.954856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:26.955974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:26.957027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 524/1054] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:26.962322 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.066635 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fc3ab-0323-4a94-a857-a94099693356 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:27.101287 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:27.101995 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.102281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.102562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.103348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:27.103660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:27.105110 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:27.118488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 531/1055] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:27.120178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.221252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1130d-fc2f-4fb3-af60-9d3613d2fe78 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:27.255713 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:27.256592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.256838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.257142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] PATH_INFO: `/v3/users/8199e4c62b5e49b8a6358de3bad46d07` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.270894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] RBAC: Authorizing `identity:get_user(user_id=8199e4c62b5e49b8a6358de3bad46d07)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:27.272382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:27.274387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 525/1056] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:27 2022] GET /identity/v3/users/8199e4c62b5e49b8a6358de3bad46d07 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:27.280386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.344961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:27.392384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23324-91df-4d51-a232-c15c67c9b942 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:27.429204 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:27.429902 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.430189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.430472 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.500739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:27.502115 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:27.558623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:27.613081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 532/1057] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:27.614940 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.650339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:27.727574 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19e8e7-267b-46c9-97e3-a4be667ea382 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:27.761830 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:27.762612 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.762932 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.763207 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.764424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:27.765893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086189fe-4d29-45f8-86aa-9efefa2366c2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:27.767799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 526/1058] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:27 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:27.773986 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.816507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77a09-3eef-4212-9b42-4de5898d570c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.816838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77a09-3eef-4212-9b42-4de5898d570c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.817098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77a09-3eef-4212-9b42-4de5898d570c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.818714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 527/1059] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:27.823665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.823955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.824234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.842255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:27.843492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:27.894046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f0a6-18e5-49a4-8888-6fc2e3dcead2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:27.923131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 528/1060] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:27.938906 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:27.939606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:27.939892 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:27.940171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:27.941020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c, user.id=8199e4c62b5e49b8a6358de3bad46d07) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:27.941343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:27.942860 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98855d6-b24d-4ba6-9e90-a0819a0a3a29 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:27.946632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:27.948958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 533/1061] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:27 2022] GET /identity/v3/role_assignments?user.id=8199e4c62b5e49b8a6358de3bad46d07&scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:27.978485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.052789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42ead-e353-4445-a137-afd80db28799 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.053032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42ead-e353-4445-a137-afd80db28799 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.053265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42ead-e353-4445-a137-afd80db28799 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.055047 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 534/1062] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:28.060820 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.061461 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.061752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.064035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cb0a8-14a6-40ec-8fdf-6f18597cbdd6 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.080266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:28.081495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:28.099233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.108815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.109772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.110059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.110579 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.123690 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:28.132033 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:28.133404 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:28.137447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 529/1063] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:28.145974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.165288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 535/1064] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:28.189790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.244680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.262600 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bedd9-9e88-4e6c-82ef-eca9f804e853 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.296112 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf6be1-0881-433b-9e90-2bf7e9e3d4fb None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.300215 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.300923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.301206 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.301485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.302252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:28.302563 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.304492 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.314150 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 530/1065] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:28.325119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.334111 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.334810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.335094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.335368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.355348 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.409011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.410467 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.442082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf2f21-c6e2-406d-ae6e-654263879dfc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.481858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.482800 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.483089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.483369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.494752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.496353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.506221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:28.516256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:28.517395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:28.518500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:28.518500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:28.518500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:28.518500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:28.518500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 531/1066] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:28.523262 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.530126 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 536/1067] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:26:28.531473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.584543 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.627292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8986fd3-b608-40bd-9e54-8392d69ca8c4 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.640256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59907e3f-8627-4d8a-b65f-9b2024168bee None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.661953 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.662640 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.662972 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.663253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.664007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:28.664353 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.665770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.677862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 532/1068] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:28.678447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.679562 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.680127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.680570 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.683671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.692946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.694792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:28.714400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:28.715700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:28.716774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:28.716774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:28.716774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:28.716774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:28.716774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 537/1069] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:28.721846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.753427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.795677 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c391d-c555-44e9-a8fe-ab15a38c1621 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.825211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c3be-f35e-4830-b640-a720af9d228c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.829168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:28.831142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.832045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.832329 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.832602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] PATH_INFO: `/v3/users/nova` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.840434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.841849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:28.856762 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:28.857911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:28.859569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 533/1070] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:28.863598 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:28.868425 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:28.869117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:28.869409 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:28.869691 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:28.870435 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:28.870782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:28.872592 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:28.895032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 538/1071] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:28.972250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafda754-b3f7-4242-bcf8-940334c78ded None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:28.995574 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.012768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.013451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.013730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.014001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.014916 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:29.015372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.016874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.037061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 534/1072] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:26:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:29.042893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.156972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bc682-77e3-4077-8573-805e8ddb3ae8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.192821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.193626 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.193908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.194179 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.205952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.207439 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:29.225663 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:29.227086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:29.228197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:29.228197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:29.228197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:29.228197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:29.228197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 539/1073] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:29.233169 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.335727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714361-6726-40b5-9879-ba5798b48e5e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.371428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.372095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.372382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.372632 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.373384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:29.373695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.375142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.386625 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 535/1074] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:29.392634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.409786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.493263 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4c3f6-697f-41a8-a238-5c97a2dbc3e1 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.530905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.531868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.532321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.532815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.543051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.544507 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:29.566238 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:29.567427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:29.568532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 540/1075] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:29.573664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.615187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.680276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be5e-6c0a-400e-9105-5377fb87f752 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.715816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.716481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.716766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.717038 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.717832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:29.718145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.719947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82afa2-5f6e-4d7a-89be-e47388efe879 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.732393 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 536/1076] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:29.738541 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:29.812487 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:29.838658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ebcbc-f5a6-472e-9a16-dce48edc4c79 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:29.875056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:29.875959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:29.876244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:29.876517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/80aeb48c3c264765a77694dd42701cf1` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:29.878932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=3f6fce810ff642dfa15292494084197e, role_id=80aeb48c3c264765a77694dd42701cf1)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:29.880375 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8dc08-0812-4b05-a075-3bab4a7a732d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:29.895550 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 541/1077] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:26:29 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/3f6fce810ff642dfa15292494084197e/roles/80aeb48c3c264765a77694dd42701cf1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:30.184421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761294a-b459-4f00-8270-86e450243e8b None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.184697 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761294a-b459-4f00-8270-86e450243e8b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.184970 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761294a-b459-4f00-8270-86e450243e8b None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.186347 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 537/1078] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:30.191809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.192068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.192346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.212389 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:30.213575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:30.284705 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 542/1079] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:30.307568 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761294a-b459-4f00-8270-86e450243e8b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:30.408489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:30.413737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761294a-b459-4f00-8270-86e450243e8b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:30.449044 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:30.449822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.450100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.450355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.460485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:30.468298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:30.469832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:30.470888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 538/1080] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:30.476278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:30.538514 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:30.578327 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882b622-ec9b-4bcc-a1ec-13654eeb6c47 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:30.614185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:30.614897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.615182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.615457 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.616212 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:30.616520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:30.617931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:30.626340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 543/1081] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:30.632396 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:30.737179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1b949-1de3-46c6-bc18-b92a82bdf617 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:30.771932 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:30.772815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.773098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.773371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] PATH_INFO: `/v3/users/8199e4c62b5e49b8a6358de3bad46d07` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.774671 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] RBAC: Authorizing `identity:get_user(user_id=8199e4c62b5e49b8a6358de3bad46d07)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:30.776174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:30.778053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 539/1082] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:30 2022] GET /identity/v3/users/8199e4c62b5e49b8a6358de3bad46d07 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:30.783772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:30.897327 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c30da-fb32-4b7d-b0cf-c271ca3ed10b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:30.922501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:30.931927 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:30.932805 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:30.933083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:30.933351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:30.934556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:30.936012 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402fc9f-711f-42f8-b755-d4c6d6056c7f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:30.938005 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 544/1083] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:30 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:30.943849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:30.973032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:31.053101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fadb41-b7b7-4b89-ac35-dbdd10205529 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:31.088516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:31.089419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:31.089703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:31.089973 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c/users/8199e4c62b5e49b8a6358de3bad46d07/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:31.092082 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] RBAC: Authorizing `identity:create_grant(project_id=1334fc7c3b70460b8403c8cdbe277c1c, user_id=8199e4c62b5e49b8a6358de3bad46d07, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:31.093556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bdca1-ecbd-4a55-8134-422851e1310f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:31.109217 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 540/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:26:30 2022] PUT /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c/users/8199e4c62b5e49b8a6358de3bad46d07/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:32.116919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3fc4-341f-4ab5-b88c-6caac03c380d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.117551 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3fc4-341f-4ab5-b88c-6caac03c380d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.117551 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3fc4-341f-4ab5-b88c-6caac03c380d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.118887 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 545/1085] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:32.124493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.124920 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.125091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.143248 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:32.144450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:32.218108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 541/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:32.242673 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3fc4-341f-4ab5-b88c-6caac03c380d None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.366898 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3fc4-341f-4ab5-b88c-6caac03c380d None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.401156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.401971 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.402255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.402504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.413790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:32.421842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:32.423151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:32.424190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 546/1087] 10.222.0.77 () {56 vars in 1120 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:32.429239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.447434 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.533553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6b619-2568-4cee-bae4-99e188202d06 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.568756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.569425 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.569707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.569986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.570802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:32.571115 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.572536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.580496 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 542/1088] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:32.586455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.645284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.691418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e631eb-e326-44dc-97ab-a2095e2b9ae8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.727062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.727866 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.728146 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.728420 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.739083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.740519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:32.758343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:32.759576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:32.760669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:32.760669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:32.760669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:32.760669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:32.760669 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 547/1089] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:32.765647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:32.847907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:32.872387 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6817c-a8b2-4c52-a9ba-6163109bf41a None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:32.908451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:32.909125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:32.909408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:32.909682 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:32.910413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:32.910739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:32.912180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:32.924280 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 543/1090] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:32.930033 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.033351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a348-9f83-4f66-9981-58bbf6b1e82f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.040737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.069766 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.070577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.070891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.071172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.079084 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.080544 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:26:33.095269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:33.096443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:33.097571 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 548/1091] 10.222.0.77 () {56 vars in 1093 bytes} [Thu May 19 20:26:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:33.102491 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.214296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f9d0-efe0-4fbd-aeef-5400fe166159 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.252963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.253642 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.253923 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.254197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.255071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:33.255383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.256860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4fb12-7792-4517-971a-0d0668b9ae6b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.265026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.276034 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 544/1092] 10.222.0.77 () {56 vars in 1133 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:33.281991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.316982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6be6-5d49-4fd7-b22c-baaffdd20c4e None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.317197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6be6-5d49-4fd7-b22c-baaffdd20c4e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.317422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6be6-5d49-4fd7-b22c-baaffdd20c4e None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.319094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 545/1093] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:26:33.325544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.325855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.326147 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.344901 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:33.346102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:33.390833 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc8db9-2482-4984-8dce-1d6315d031cb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.415312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 546/1094] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:33.425485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294476c-c150-486f-820b-cf865346b162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.426147 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294476c-c150-486f-820b-cf865346b162 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.426429 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294476c-c150-486f-820b-cf865346b162 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.426711 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294476c-c150-486f-820b-cf865346b162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.438911 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.460419 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.497532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294476c-c150-486f-820b-cf865346b162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.499053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294476c-c150-486f-820b-cf865346b162 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.536795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7be9f-3c89-4cd2-a07a-03d23bdf97ea None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.563260 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.572560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.573321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.573602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.573888 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.584330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:33.592071 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:33.593381 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:26:33.595000 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 547/1095] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:33.599869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.612726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 549/1096] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:33.613776 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294476c-c150-486f-820b-cf865346b162 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.678020 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.703472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54db5e-0678-4e01-ba1a-280f6c5d7355 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.713037 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294476c-c150-486f-820b-cf865346b162 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.737237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.738129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.738422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.738706 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.739493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:33.739803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.741223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.748451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.749254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.749367 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 548/1097] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:33.749539 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.749815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.755132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.760161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.761650 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:26:33.779603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:33.780709 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:33.781793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:26:33.781793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:26:33.781793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:26:33.781793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:33.781793 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 550/1098] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:33.786485 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.804964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.857202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4fa70-3f32-4107-b182-3fb2a2845fb2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.888731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653664da-3a7f-43fa-9aab-29707f3c817f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:33.890292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.891225 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.891503 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.891783 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] PATH_INFO: `/v3/users/8199e4c62b5e49b8a6358de3bad46d07` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.892993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] RBAC: Authorizing `identity:get_user(user_id=8199e4c62b5e49b8a6358de3bad46d07)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.894470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.896152 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 549/1099] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/users/8199e4c62b5e49b8a6358de3bad46d07 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:33.903775 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:33.907029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:33.926707 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:33.927397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:33.927681 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:33.927959 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:33.928693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:33.928999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:33.930502 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:33.943438 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 551/1100] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:33.949239 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:34.013325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b6ac-f24b-4e90-b719-9dd6854eadf2 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.029296 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:34.048641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.049300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.049584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.049861 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.054003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af43adf-424e-48e3-8675-88c8424148d2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.089532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.090350 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.090633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.090940 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.098200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.099713 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:26:34.114382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:34.115520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:34.116634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 552/1101] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:26:34.121784 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:34.124836 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.126349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.165537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:34.233459 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 550/1102] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:26:34.236681 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00a0a-1a09-4b02-a741-c3330cc6000e None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.240385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:34.264355 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:34.278498 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.279210 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.279502 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.279782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.280620 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:34.280934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.282400 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.295576 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 553/1103] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:26:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:34.301677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:34.352023 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b175-1bd1-4b70-8af0-91f9ee12a824 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.387417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.388672 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.388963 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.389238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.390479 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.392010 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.393704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 551/1104] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:34 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:34.399881 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:34.402912 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:34.407318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d9b66-7269-43cb-b969-c724eacfe17c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.444053 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.444693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.444981 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.445362 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.446211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] RBAC: Adding query filter params (role.id=80aeb48c3c264765a77694dd42701cf1, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=3f6fce810ff642dfa15292494084197e) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:34.446528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.448000 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862dd56-4d10-403c-81b4-3bd9c6aaf1cb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.454031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 554/1105] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:34 2022] GET /identity/v3/role_assignments?user.id=3f6fce810ff642dfa15292494084197e&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=80aeb48c3c264765a77694dd42701cf1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:34.492369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:34.511485 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4539f-60c2-42c6-9899-d7ce9d4ad494 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:34.551712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:34.552385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:34.552672 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:34.552953 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:34.553809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c, user.id=8199e4c62b5e49b8a6358de3bad46d07) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:34.554122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:34.555841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281b54-5ae1-43c8-b4ea-a1740e0078bf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:34.563108 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 552/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:34 2022] GET /identity/v3/role_assignments?user.id=8199e4c62b5e49b8a6358de3bad46d07&scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:26:36.825086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea2c0-9ba8-4c1b-84de-219f68d354b7 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:36.825723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea2c0-9ba8-4c1b-84de-219f68d354b7 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:36.825723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea2c0-9ba8-4c1b-84de-219f68d354b7 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:36.827055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 555/1107] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:36.833515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:36.834270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:36.834444 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:36.855176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:36.856372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:36.942067 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 553/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:36.974633 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea2c0-9ba8-4c1b-84de-219f68d354b7 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:37.086654 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea2c0-9ba8-4c1b-84de-219f68d354b7 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:37.132129 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:37.133282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:37.133664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:37.134011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:37.135304 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:37.136742 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d046013-f434-45ed-aa3f-49ff0295540b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:37.138330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 556/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:37.147176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:37.232277 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:37.276375 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605619f-9437-454f-96f4-adefc76dcc8a None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:37.318026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:37.318717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:37.319018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:37.319303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:37.320028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:37.321576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9a94-9f6b-4595-bb58-f3365bf485a3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:37.342486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 554/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:26:37 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:39.612290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb39b-4f61-455c-bbaa-27fef1f7eb53 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:39.613170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb39b-4f61-455c-bbaa-27fef1f7eb53 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:39.613170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb39b-4f61-455c-bbaa-27fef1f7eb53 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:39.615384 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 557/1111] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:39.622055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:39.622898 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:39.623103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:39.645421 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:39.646608 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:39.734529 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 555/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:39.758736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdb39b-4f61-455c-bbaa-27fef1f7eb53 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:39.800727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:39.890556 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdb39b-4f61-455c-bbaa-27fef1f7eb53 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:39.929019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:39.929886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:39.930171 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:39.930453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] PATH_INFO: `/v3/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:39.932149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] RBAC: Authorizing `identity:get_role(role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:39.933533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:39.934989 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 558/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:39 2022] GET /identity/v3/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:39.941202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:40.008947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:40.050674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb623a1-6acb-4a21-940e-af9cd0aa6544 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:40.087588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:40.088462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.088750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.089080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] PATH_INFO: `/v3/users/c9fb5b550112455dae897058aee5137b` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.104683 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fb5b550112455dae897058aee5137b)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:40.106166 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:40.107883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 556/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:39 2022] GET /identity/v3/users/c9fb5b550112455dae897058aee5137b => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:40.114076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:40.229812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:40.233952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fa7c0-f458-4d3e-9d45-d5ac098d179c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:40.270161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:40.270854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.271139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.271418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.348860 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:40.350351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:40.462464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:40.467257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 559/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:40.476847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:40.584865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f43aa-377b-436b-8ec2-aeef2bf7eec7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:40.608969 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:40.623409 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:40.624276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.624560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.624830 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.626078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:40.627575 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5396a-47c2-49ec-af5b-e493923237a8 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:40.629301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 557/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:40 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:40.635984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:40.743081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44715-34d3-483c-9a03-687f67b82852 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:40.780803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:40.781455 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:40.781736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:40.782013 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:40.782882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c, user.id=c9fb5b550112455dae897058aee5137b) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:40.783197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:40.784623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bfb7-74b6-4045-b69d-d0b3decaadcd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:40.790281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 560/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:40 2022] GET /identity/v3/role_assignments?user.id=c9fb5b550112455dae897058aee5137b&scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:42.991385 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6bc5-3892-4db8-8eb1-8cea48c6e93c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:42.992014 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6bc5-3892-4db8-8eb1-8cea48c6e93c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:42.992014 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae6bc5-3892-4db8-8eb1-8cea48c6e93c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:42.993408 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 558/1118] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:42.999925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.000738 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.000858 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.027958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:43.029139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:43.088330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:43.099837 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 561/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:43.123968 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae6bc5-3892-4db8-8eb1-8cea48c6e93c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:43.238256 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae6bc5-3892-4db8-8eb1-8cea48c6e93c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:43.274183 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:43.275032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.275317 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.275594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] PATH_INFO: `/v3/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.277164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] RBAC: Authorizing `identity:get_role(role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:43.278584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:43.279990 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 559/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:43 2022] GET /identity/v3/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:43.286737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:43.398286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26f07-c00c-4546-9c92-ec268c6a4fe2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:43.435385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:43.436275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.436536 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.436797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] PATH_INFO: `/v3/users/c9fb5b550112455dae897058aee5137b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.438036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fb5b550112455dae897058aee5137b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:43.439520 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:43.441192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 562/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:43 2022] GET /identity/v3/users/c9fb5b550112455dae897058aee5137b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:43.447992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:43.525939 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:43.570420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8744d-dc70-4b13-86c9-bf2921e556c0 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:43.615615 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:43.616874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.617233 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.617602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.619263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:43.620744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd056-ef2b-44d4-8460-7e7d06686be6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:43.622457 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 560/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:43 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:43.628653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:43.701139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:43.749643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050641a4-5ed7-4a36-9208-97e6d9277ee5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:43.784821 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:43.785639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:43.785917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:43.786194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c/users/c9fb5b550112455dae897058aee5137b/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:43.788594 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=1334fc7c3b70460b8403c8cdbe277c1c, user_id=c9fb5b550112455dae897058aee5137b, role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:43.790026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905d987-d16d-4ecb-a04f-86c16c6a5cdd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:43.808202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 563/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:26:43 2022] PUT /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c/users/c9fb5b550112455dae897058aee5137b/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:26:45.997507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c152d7-82da-40a6-900e-2e555f59c466 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:45.998092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c152d7-82da-40a6-900e-2e555f59c466 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:45.998092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c152d7-82da-40a6-900e-2e555f59c466 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.000193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 561/1124] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:46.009038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.009524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.009637 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.027896 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:46.029062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:46.104346 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 564/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 20:26:46.128175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c152d7-82da-40a6-900e-2e555f59c466 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.237263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c152d7-82da-40a6-900e-2e555f59c466 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.263363 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.275660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.276527 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.276814 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.277095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] PATH_INFO: `/v3/roles/0ba2206d7ee64ce8963d3b39943f7142` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.278709 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] RBAC: Authorizing `identity:get_role(role_id=0ba2206d7ee64ce8963d3b39943f7142)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:46.280146 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:46.281551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 562/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/roles/0ba2206d7ee64ce8963d3b39943f7142 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:46.292868 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.360061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.411279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f20b5-5daf-48e7-83a2-6247d455f59b None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.449838 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.450739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.451011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.451275 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] PATH_INFO: `/v3/users/c9fb5b550112455dae897058aee5137b` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.452474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] RBAC: Authorizing `identity:get_user(user_id=c9fb5b550112455dae897058aee5137b)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:46.453919 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:46.455604 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 565/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/users/c9fb5b550112455dae897058aee5137b => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:46.462203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.571153 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16623fd-fb7a-4381-a4fe-4e3313aef987 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.609525 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.610504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.610955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.611358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.683695 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.692340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:46.693839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:46.803497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 563/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:46.812893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:46.919357 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41c72f-5aa9-464f-9adf-77de7859be49 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:46.939867 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:46.961797 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:46.962856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:46.963122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:46.963392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] PATH_INFO: `/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:46.964764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] RBAC: Authorizing `identity:get_project(project_id=1334fc7c3b70460b8403c8cdbe277c1c)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:46.966214 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982d85c-841b-4b6b-ac27-483628065a67 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:46.967984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 566/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/projects/1334fc7c3b70460b8403c8cdbe277c1c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:46.975617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:47.086913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:47.095520 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d5dc1-447f-4d95-be8c-8c5366f2e88f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:47.132841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:47.133501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:47.133847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:47.134107 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:47.134975 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] RBAC: Adding query filter params (role.id=0ba2206d7ee64ce8963d3b39943f7142, scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c, user.id=c9fb5b550112455dae897058aee5137b) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:47.135292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:47.136772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36c63-55a7-41f3-84e9-038e6c9c2e18 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:47.142902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 564/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:46 2022] GET /identity/v3/role_assignments?user.id=c9fb5b550112455dae897058aee5137b&scope.project.id=1334fc7c3b70460b8403c8cdbe277c1c&role.id=0ba2206d7ee64ce8963d3b39943f7142 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:49.399872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e9f13-137a-43bd-ace8-fc328f41a0c4 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.400447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e9f13-137a-43bd-ace8-fc328f41a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.400447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e9f13-137a-43bd-ace8-fc328f41a0c4 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:49.402588 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 567/1131] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:49.411411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.411850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.411993 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:49.432303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:49.433501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:49.505039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 565/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:49.536132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e9f13-137a-43bd-ace8-fc328f41a0c4 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:49.644121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e9f13-137a-43bd-ace8-fc328f41a0c4 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:49.687673 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:49.688476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.688759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.689036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:49.690345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:49.691816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df604100-e7ed-474d-bc08-62c8dfd60eed None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:49.693480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 568/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:49.699845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:49.799222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:49.814402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f7ac-6d92-46cd-8fdf-8152f4e729e8 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:49.852586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:49.853243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:49.853528 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:49.853814 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:49.854514 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:49.856062 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dd8ec-1e40-4329-a624-1d0772b471d5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:49.887411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 566/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:26:49 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:52.119491 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799331d4-3223-4ef6-a4c7-d30d60ff4f55 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:52.120382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799331d4-3223-4ef6-a4c7-d30d60ff4f55 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:52.120382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799331d4-3223-4ef6-a4c7-d30d60ff4f55 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:52.122557 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 569/1135] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:52.131382 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:52.131852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:52.132021 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:52.150395 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:52.151637 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:52.223581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 567/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:52.251737 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799331d4-3223-4ef6-a4c7-d30d60ff4f55 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:52.312924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:52.363255 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799331d4-3223-4ef6-a4c7-d30d60ff4f55 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:52.399265 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:52.400063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:52.400343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:52.400615 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:52.401853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:52.403301 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572548e9-78a1-486a-925c-ee25e71c1b24 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:52.404993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 570/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:52.411449 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:52.487178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:52.522455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f721e-c842-4d19-b625-885b1a4848ff None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:52.557752 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:52.558419 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:52.558727 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:52.559001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:52.559719 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:52.561189 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e741a2-2805-41eb-9ba4-4a9b688efbcf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:52.587489 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 568/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:26:52 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:26:54.859224 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122244e-1269-449c-8cec-f67081015d89 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:54.860170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122244e-1269-449c-8cec-f67081015d89 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:54.860170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122244e-1269-449c-8cec-f67081015d89 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:54.862318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 571/1139] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:54.869110 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:54.869841 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:54.869942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:54.897494 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:54.899468 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:54.971583 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 569/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:54.995456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122244e-1269-449c-8cec-f67081015d89 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:55.117003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122244e-1269-449c-8cec-f67081015d89 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:55.141310 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:55.156316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:55.157122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:55.157412 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:55.157690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:55.170069 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:55.177878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:55.179173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:55.180231 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 572/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:55.185590 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:55.243518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:55.289412 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6bf27-5764-4b76-ac9f-b9ba5ed60723 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:55.324997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:55.325705 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:55.325991 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:55.326264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:55.327064 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:55.327374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:55.328784 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:55.338314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 570/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:55.344847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:55.457116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b3d6-2be7-4c7a-b12a-3babe3a1f390 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:55.496198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:55.497083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:55.497367 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:55.497645 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] PATH_INFO: `/v3/users/183c1b9605d2431fbf119b86fb380184` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:55.512908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] RBAC: Authorizing `identity:get_user(user_id=183c1b9605d2431fbf119b86fb380184)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:55.514398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:55.516092 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 573/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:55 2022] GET /identity/v3/users/183c1b9605d2431fbf119b86fb380184 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:55.522136 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:55.635086 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ba449-f84e-4f1d-a322-3b04d5c8d8bf None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:55.652767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:55.681655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:55.682302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:55.682592 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:55.682907 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:55.754070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:55.755523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:55.872047 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 571/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:26:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:26:55.881209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:55.931240 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:55.991785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170bc7-e2b1-46b4-84e9-9e94cae0f645 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:56.027394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:56.028176 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:56.028456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:56.028730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] PATH_INFO: `/v3/projects/d2a8f488184d42d69d1bbaaf6728df74` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:56.030048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8f488184d42d69d1bbaaf6728df74)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:56.031508 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d56dd-fda9-494e-aeb6-af532057a701 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:56.033209 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 574/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:55 2022] GET /identity/v3/projects/d2a8f488184d42d69d1bbaaf6728df74 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:56.040451 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:56.072325 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:56.173095 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfd21-d7d6-4024-9992-83598284305f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:56.213124 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:56.213795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:56.214084 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:56.214383 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:56.215300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=d2a8f488184d42d69d1bbaaf6728df74, user.id=183c1b9605d2431fbf119b86fb380184) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:56.215615 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:56.217096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723f55f-5952-4808-879b-e82e0ad8db3f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:56.223174 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 572/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:26:56 2022] GET /identity/v3/role_assignments?user.id=183c1b9605d2431fbf119b86fb380184&scope.project.id=d2a8f488184d42d69d1bbaaf6728df74&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:58.386845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061af1-2b55-46fc-bc42-3274d98dbaa6 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:58.387423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061af1-2b55-46fc-bc42-3274d98dbaa6 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:58.387423 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061af1-2b55-46fc-bc42-3274d98dbaa6 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:58.388788 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 575/1147] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:26:58.395452 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:58.396255 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:58.396424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:58.421001 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:26:58.422197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:26:58.498078 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 573/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:26:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:26:58.540882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061af1-2b55-46fc-bc42-3274d98dbaa6 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:58.668016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061af1-2b55-46fc-bc42-3274d98dbaa6 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:58.677537 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:58.715197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:58.715999 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:58.716282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:58.716563 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:58.727787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:26:58.735408 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:26:58.736735 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:26:58.737972 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 576/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:26:58.743022 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:58.758173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:58.848810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125929bf-ce86-4624-a47f-fdbff8b5c0b4 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:58.884578 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:58.885239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:58.885519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:58.885792 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:58.886552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:26:58.886894 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:58.888306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:58.896647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 574/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:58.903501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:59.010574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874f1e-f4fe-472b-8e8e-d4aa6edff51b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:59.046545 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:59.047446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:59.047727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:59.047993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] PATH_INFO: `/v3/users/183c1b9605d2431fbf119b86fb380184` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:59.049222 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] RBAC: Authorizing `identity:get_user(user_id=183c1b9605d2431fbf119b86fb380184)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:59.050660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:59.052443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 577/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:26:58 2022] GET /identity/v3/users/183c1b9605d2431fbf119b86fb380184 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:59.058482 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:59.142294 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:59.176240 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0977-1b51-47ee-8cb3-2ff7be859a05 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:59.211818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:59.212697 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:59.212977 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:59.213252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] PATH_INFO: `/v3/projects/d2a8f488184d42d69d1bbaaf6728df74` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:59.214509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8f488184d42d69d1bbaaf6728df74)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:59.216024 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f84197-1fc1-4aa9-82b1-fb59e645d381 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:59.217767 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 575/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:26:59 2022] GET /identity/v3/projects/d2a8f488184d42d69d1bbaaf6728df74 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:26:59.227364 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:26:59.263450 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:26:59.329681 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6b510-a716-46aa-8c62-25d2192eeda2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:26:59.366467 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:26:59.367399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:26:59.367708 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:26:59.368046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] PATH_INFO: `/v3/projects/d2a8f488184d42d69d1bbaaf6728df74/users/183c1b9605d2431fbf119b86fb380184/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:26:59.370127 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2a8f488184d42d69d1bbaaf6728df74, user_id=183c1b9605d2431fbf119b86fb380184, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:26:59.371603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87abb-2742-423b-8cab-ce45c8b1ad47 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:26:59.392644 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 578/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:26:59 2022] PUT /identity/v3/projects/d2a8f488184d42d69d1bbaaf6728df74/users/183c1b9605d2431fbf119b86fb380184/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:27:01.600377 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46d029-18b5-4c91-a624-d6dfe432fb25 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:01.601254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46d029-18b5-4c91-a624-d6dfe432fb25 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:01.601254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46d029-18b5-4c91-a624-d6dfe432fb25 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:01.603194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 576/1154] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:01.612290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:01.612743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:01.612854 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:01.633066 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:01.634271 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:01.706089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 579/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:01.737439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46d029-18b5-4c91-a624-d6dfe432fb25 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:01.845391 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46d029-18b5-4c91-a624-d6dfe432fb25 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:01.881306 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:01.882101 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:01.882384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:01.882660 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:01.894005 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:27:01.901747 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:27:01.903918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:27:01.904956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 577/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:27:01.909532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:01.938715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:02.015121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325aa9a-47e5-4b99-9e1f-1b9e6b9154b3 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:02.059192 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:02.059866 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:02.060153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:02.060434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:02.061191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:02.061508 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:02.062932 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:02.071344 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 580/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:02.080496 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:02.084822 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:02.194917 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9f36-2b0c-4237-a177-556c51a4f346 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:02.233562 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:02.234424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:02.234730 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:02.235002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] PATH_INFO: `/v3/users/183c1b9605d2431fbf119b86fb380184` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:02.236323 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=183c1b9605d2431fbf119b86fb380184)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:02.237787 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:02.239450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 578/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:27:02 2022] GET /identity/v3/users/183c1b9605d2431fbf119b86fb380184 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:02.246326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:02.364303 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:02.377806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d08b2-e945-4a47-b973-980762dd9b9f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:02.422529 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:02.423222 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:02.423505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:02.423782 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:02.500219 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:02.501623 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:02.595398 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:02.610168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 581/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:27:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:27:02.616514 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:02.701759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:02.744764 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be99d5-dc5d-4088-9ab7-bdeffe5a0fb7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:02.779050 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:02.779878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:02.780157 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:02.780435 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] PATH_INFO: `/v3/projects/d2a8f488184d42d69d1bbaaf6728df74` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:02.781707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] RBAC: Authorizing `identity:get_project(project_id=d2a8f488184d42d69d1bbaaf6728df74)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:02.783218 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be447da-6994-4387-a991-10dd77ff803c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:02.784942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 579/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:27:02 2022] GET /identity/v3/projects/d2a8f488184d42d69d1bbaaf6728df74 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:02.793200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:02.897621 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be453cd-479b-4764-acf7-8e8d7a4ab1ff None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:02.947524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:02.948169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:02.948446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:02.948722 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:02.949558 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=d2a8f488184d42d69d1bbaaf6728df74, user.id=183c1b9605d2431fbf119b86fb380184) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:02.949870 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:02.951338 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa759-c73d-41a3-b75d-08c7e280628e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:02.957437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 582/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:27:02 2022] GET /identity/v3/role_assignments?user.id=183c1b9605d2431fbf119b86fb380184&scope.project.id=d2a8f488184d42d69d1bbaaf6728df74&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:05.173847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ab4c-9f3a-4f03-aab6-8bdbb482ebbb None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:05.174490 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ab4c-9f3a-4f03-aab6-8bdbb482ebbb None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:05.174490 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ab4c-9f3a-4f03-aab6-8bdbb482ebbb None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:05.175839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 580/1162] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:05.182368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:05.183293 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:05.183293 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:05.206145 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:05.207404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:05.265593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:05.288149 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 583/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:05.314083 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ab4c-9f3a-4f03-aab6-8bdbb482ebbb None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:05.426055 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ab4c-9f3a-4f03-aab6-8bdbb482ebbb None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:05.465819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:05.466475 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:05.466796 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:05.467077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:05.475858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:05.537389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:05.538952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:05.644789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 581/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:27:05.651392 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:05.778582 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a3e57-0437-4a0d-9e97-587ff733322f None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:05.814059 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:05.814909 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:05.815191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:05.815466 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:05.822385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:05.823875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-db917b36-a92d-40fb-9bb5-925a82a20c5c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:27:05.838256 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:27:05.839840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:27:05.841164 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 584/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:27:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:27:05.846654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:05.892936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:05.964112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577980a3-7e8f-4e71-9502-d83b32fa79f9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:06.002986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:06.003641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:06.003918 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:06.004187 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:06.004908 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:06.005211 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:06.006605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bc153-a2b8-4f6b-a8c3-e87de3fdd772 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:06.014032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 582/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Thu May 19 20:27:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:08.212041 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5521-fefa-4ddd-b168-27fd99cf90e4 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:08.212675 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5521-fefa-4ddd-b168-27fd99cf90e4 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:08.212675 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5521-fefa-4ddd-b168-27fd99cf90e4 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:08.213979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 585/1167] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:08.220843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8754-3d32-4c82-9544-09d7763c1633 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:08.221275 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8754-3d32-4c82-9544-09d7763c1633 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:08.221400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8754-3d32-4c82-9544-09d7763c1633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:08.247020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-57ec8754-3d32-4c82-9544-09d7763c1633 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:08.248300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-57ec8754-3d32-4c82-9544-09d7763c1633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:08.319788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 583/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:08.343895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5521-fefa-4ddd-b168-27fd99cf90e4 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:08.398931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:08.464629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5521-fefa-4ddd-b168-27fd99cf90e4 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:08.500653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:08.501321 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:08.501610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:08.501895 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:08.502643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:08.504082 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1628f6-523f-42d3-b5ec-f38c4782507b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:08.526292 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 586/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Thu May 19 20:27:08 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:27:10.763098 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3bee-fe41-499d-aab5-f2932c2d098c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:10.763712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3bee-fe41-499d-aab5-f2932c2d098c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:10.763712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3bee-fe41-499d-aab5-f2932c2d098c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:10.765051 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 584/1170] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:10.771678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:10.772152 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:10.772266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:10.791600 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:10.792789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:10.873104 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 587/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:10.897070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3bee-fe41-499d-aab5-f2932c2d098c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:10.933506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:11.008680 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3bee-fe41-499d-aab5-f2932c2d098c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:11.043875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:11.044661 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:11.044942 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:11.045198 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] PATH_INFO: `/v3/domains/031387f6ee76499b9b74ea593462f6b4` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:11.056041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] RBAC: Authorizing `identity:get_domain(domain_id=031387f6ee76499b9b74ea593462f6b4)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:11.057523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fe1b4-430e-43d7-adf7-3f0c176a741f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:11.059203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 585/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 20:27:10 2022] GET /identity/v3/domains/031387f6ee76499b9b74ea593462f6b4 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:11.065506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:11.103381 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:11.191792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b92099-e6e6-47c8-90a2-5dd4656303ae None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:11.229983 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:11.230674 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:11.230994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:11.231269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:11.231988 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:11.233429 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9abb0e-ee1a-44d4-b633-bbccde2fcefa None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:11.261799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 588/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:27:11 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:27:13.518273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87a1e-9c88-4d1b-a9cb-10ae87b7e0fe None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:13.518921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87a1e-9c88-4d1b-a9cb-10ae87b7e0fe None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:13.518921 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87a1e-9c88-4d1b-a9cb-10ae87b7e0fe None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:13.520229 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 586/1174] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:13.526964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:13.527430 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:13.527540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:13.556282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:13.557484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:13.628462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 589/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:13.653863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87a1e-9c88-4d1b-a9cb-10ae87b7e0fe None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:13.766354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:13.777858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87a1e-9c88-4d1b-a9cb-10ae87b7e0fe None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:13.816286 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:13.817156 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:13.817439 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:13.817712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] PATH_INFO: `/v3/domains/031387f6ee76499b9b74ea593462f6b4` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:13.818997 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=031387f6ee76499b9b74ea593462f6b4)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:13.820501 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f0c6a-3e52-4e09-b2ed-ee3fce3a9f25 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:13.822137 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 587/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Thu May 19 20:27:13 2022] GET /identity/v3/domains/031387f6ee76499b9b74ea593462f6b4 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:13.831580 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:13.849453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:13.941540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03b184-c59b-4ddf-99a8-d088cca5512a None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:13.979421 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:13.980102 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:13.980386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:13.980666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:13.981371 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:13.982885 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7a04f-1936-4ff3-a8c4-65e9b2f682c6 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:14.005137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 590/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:27:13 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:27:16.256273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f534f-e072-4642-a63f-7cbee8f91850 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:16.257222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f534f-e072-4642-a63f-7cbee8f91850 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:16.257222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f534f-e072-4642-a63f-7cbee8f91850 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:16.259619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 588/1178] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:16.265202 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:16.265672 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:16.265785 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:16.285432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:16.286619 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:16.352993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:16.359051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 591/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:16.382586 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f534f-e072-4642-a63f-7cbee8f91850 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:16.492737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f534f-e072-4642-a63f-7cbee8f91850 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:16.532129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:16.532857 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:16.533143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:16.533420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:16.545581 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:27:16.553237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:27:16.554443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:27:16.555949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 589/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:27:16.560989 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:16.673607 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764178d-1f62-41f3-aff1-afb19429fb9e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:16.709806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:16.710471 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:16.710774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:16.711103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:16.711853 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:16.712154 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:16.713533 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:16.722173 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 592/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:27:16.731847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:16.758812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:16.841938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a750-de40-44bc-9690-1a8c5d7a2146 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:16.877633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:16.878497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:16.878803 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:16.879075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] PATH_INFO: `/v3/users/ddf349a8e8dc463d88290b5498cd9487` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:16.894111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ddf349a8e8dc463d88290b5498cd9487)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:16.895620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:16.897288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 590/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:27:16 2022] GET /identity/v3/users/ddf349a8e8dc463d88290b5498cd9487 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:16.906188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:16.981056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:17.030456 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cbffd-7101-4b79-b5d1-bb3a58162026 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:17.070432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:17.071141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:17.071427 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:17.071706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:17.147501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:17.148949 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:17.211295 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:17.252890 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 593/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:27:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 20:27:17.259243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:17.349666 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:17.378816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764c219-4dc0-47fa-96f5-c1e220ba85a3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:17.415161 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:17.415961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:17.416223 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:17.416507 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] PATH_INFO: `/v3/projects/17acca01173b4915a00260dbac265d69` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:17.417754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] RBAC: Authorizing `identity:get_project(project_id=17acca01173b4915a00260dbac265d69)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:17.419261 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bafa9-88a5-474f-912b-bf6fcd465877 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:17.420996 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 591/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:27:17 2022] GET /identity/v3/projects/17acca01173b4915a00260dbac265d69 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:17.427698 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:17.532011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff0794-8209-4fc3-b2d0-a674027b7267 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:17.568001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:17.568665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:17.568950 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:17.569229 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:17.570061 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=17acca01173b4915a00260dbac265d69, user.id=ddf349a8e8dc463d88290b5498cd9487) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:17.570411 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:17.571884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04165690-6feb-43fb-8540-3b5e7c7b32dd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:17.577540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 594/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:27:17 2022] GET /identity/v3/role_assignments?user.id=ddf349a8e8dc463d88290b5498cd9487&scope.project.id=17acca01173b4915a00260dbac265d69&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:19.758399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df77a7-af83-44d7-b3d6-3cd305103597 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:19.759056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df77a7-af83-44d7-b3d6-3cd305103597 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:19.759056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df77a7-af83-44d7-b3d6-3cd305103597 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:19.760380 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 592/1186] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:19.767018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:19.767778 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:19.767957 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:19.788160 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:19.789380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:19.813734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:19.870743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 595/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:19.899031 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df77a7-af83-44d7-b3d6-3cd305103597 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:20.006625 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df77a7-af83-44d7-b3d6-3cd305103597 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:20.049178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:20.049902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:20.050185 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:20.050462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:20.062534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:27:20.070102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:27:20.071484 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:27:20.072626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 593/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:27:20.080194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:20.191511 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce8a0-61df-413b-bf03-991b7cabdc2e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:20.231519 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:20.232193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:20.232476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:20.232752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:20.233531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:20.233840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:20.235270 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:20.243643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 596/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:20.250087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:20.260330 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:20.362477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1649-47bf-4156-a66a-55da8ff25bd6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:20.399311 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:20.400182 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:20.400463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:20.400739 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] PATH_INFO: `/v3/users/ddf349a8e8dc463d88290b5498cd9487` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:20.402075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] RBAC: Authorizing `identity:get_user(user_id=ddf349a8e8dc463d88290b5498cd9487)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:20.403588 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:20.405237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 594/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:27:20 2022] GET /identity/v3/users/ddf349a8e8dc463d88290b5498cd9487 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:20.411484 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:20.437148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:20.538040 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e587f20-2f83-4ed1-9e0e-486fc152a8b0 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:20.574994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:20.575857 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:20.576132 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:20.576397 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] PATH_INFO: `/v3/projects/17acca01173b4915a00260dbac265d69` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:20.577724 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] RBAC: Authorizing `identity:get_project(project_id=17acca01173b4915a00260dbac265d69)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:20.579274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43bf18-5e1b-4c28-b654-016947c12f95 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:20.580929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 597/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:27:20 2022] GET /identity/v3/projects/17acca01173b4915a00260dbac265d69 => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:27:20.587461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:20.669776 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:20.696678 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d6b4e-135f-4dcf-b010-8072395d9b6f None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:20.732865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:20.733756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:20.734040 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:20.734321 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] PATH_INFO: `/v3/projects/17acca01173b4915a00260dbac265d69/users/ddf349a8e8dc463d88290b5498cd9487/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:20.736455 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] RBAC: Authorizing `identity:create_grant(project_id=17acca01173b4915a00260dbac265d69, user_id=ddf349a8e8dc463d88290b5498cd9487, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:20.737944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0d103-319d-4669-8590-ebbc830adb04 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:20.758780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 595/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:27:20 2022] PUT /identity/v3/projects/17acca01173b4915a00260dbac265d69/users/ddf349a8e8dc463d88290b5498cd9487/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:27:22.950753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99c7f-ae70-4932-858c-f59d9b5c66b1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:22.951694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99c7f-ae70-4932-858c-f59d9b5c66b1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:22.951694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb99c7f-ae70-4932-858c-f59d9b5c66b1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:22.953964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 598/1193] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:27:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:27:22.960704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:22.961609 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:22.961609 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:22.985450 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:27:22.986654 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:27:23.059748 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 596/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:27:23.083686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb99c7f-ae70-4932-858c-f59d9b5c66b1 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:23.175442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:23.193730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb99c7f-ae70-4932-858c-f59d9b5c66b1 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:23.229052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:23.229780 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:23.230056 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:23.230326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:23.240969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:27:23.248636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:27:23.253921 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:27:23.255278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 599/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:27:23.257851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:23.324902 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:23.369461 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271e3b-0dd0-4639-b028-32c8a6828c53 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:23.404309 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:23.404978 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:23.405269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:23.405547 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:23.406372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:23.406665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:23.408121 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:23.416433 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 597/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:23.423108 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:23.533116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2796dce-2254-4f48-9946-fa8c44ea4134 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:23.569586 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:23.570730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:23.571003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:23.571279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] PATH_INFO: `/v3/users/ddf349a8e8dc463d88290b5498cd9487` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:23.572617 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] RBAC: Authorizing `identity:get_user(user_id=ddf349a8e8dc463d88290b5498cd9487)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:23.574083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:23.575799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 600/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Thu May 19 20:27:23 2022] GET /identity/v3/users/ddf349a8e8dc463d88290b5498cd9487 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:23.582131 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:23.691848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05fe30-089d-4a69-bee7-3db55ac5df5e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:23.717799 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:23.728195 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:23.728819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:23.729125 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:23.729386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:23.797949 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:23.799420 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:23.904662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 598/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:27:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:27:23.911500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:23.929374 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:24.021334 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cb36a-43fd-446e-ada1-bfa1748ca587 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:24.059478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:24.060282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:24.060565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:24.060844 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] PATH_INFO: `/v3/projects/17acca01173b4915a00260dbac265d69` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:24.062151 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] RBAC: Authorizing `identity:get_project(project_id=17acca01173b4915a00260dbac265d69)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:24.063614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd1cdf-e2cf-4a65-8c54-64a435106e64 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:24.065370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 601/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Thu May 19 20:27:23 2022] GET /identity/v3/projects/17acca01173b4915a00260dbac265d69 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:24.074952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:27:24.105072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:24.196515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8972b1-b1c6-467e-a7ab-1eb7c68acb68 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:27:24.233884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:27:24.234536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:27:24.234825 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:27:24.235122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:27:24.235964 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=17acca01173b4915a00260dbac265d69, user.id=ddf349a8e8dc463d88290b5498cd9487) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:27:24.236273 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:27:24.237789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f0cf-ce50-4630-9af1-c64a1b32ac77 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:27:24.244384 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 599/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:27:24 2022] GET /identity/v3/role_assignments?user.id=ddf349a8e8dc463d88290b5498cd9487&scope.project.id=17acca01173b4915a00260dbac265d69&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:27:34.054076 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=59 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:27:34.241253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=55 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:22.867488 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c68de-d10f-4d14-9ed0-4dd0a95a8244 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:22.868123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c68de-d10f-4d14-9ed0-4dd0a95a8244 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:22.868123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c68de-d10f-4d14-9ed0-4dd0a95a8244 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:22.869388 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 602/1201] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:22.875141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:22.875617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:22.875710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:22.893860 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:22.895089 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:22.976816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 600/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:23.005552 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c68de-d10f-4d14-9ed0-4dd0a95a8244 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.119924 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c68de-d10f-4d14-9ed0-4dd0a95a8244 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.154474 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.155323 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.155605 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.155882 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.166349 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:23.167848 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:23.188643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:23.189916 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:23.191720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:23.191720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:23.191720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:23.191720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:23.191720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 603/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:23.197302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.301702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536b9ae-83d2-46d5-a84a-58a22ee826cb None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.335759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:23.343553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.344234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.344518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.344795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.345533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:23.345845 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:23.347291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3bf96-5865-4d16-9d4f-1b8596bbb24e None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:23.363930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 601/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:23.365242 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:23.431182 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:23.480143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b96392-6fea-4ad2-a7d4-db70db4d1716 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:23.515479 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:23.516072 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:23.516360 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:23.516618 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:23.517336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:23.518816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b037-2516-4cc7-a978-694ea3663878 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:23.544953 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 604/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Thu May 19 20:28:23 2022] POST /identity/v3/users => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:28:26.099853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228001f-10b4-4657-a7cc-8c1b9a24dedc None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:26.100473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228001f-10b4-4657-a7cc-8c1b9a24dedc None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:26.100473 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228001f-10b4-4657-a7cc-8c1b9a24dedc None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:26.102219 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 602/1206] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:26.108437 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:26.108930 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:26.109042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:26.129370 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:26.130991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:26.214298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 605/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:26.240359 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228001f-10b4-4657-a7cc-8c1b9a24dedc None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:26.379720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228001f-10b4-4657-a7cc-8c1b9a24dedc None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:26.419819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:26.421339 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:26.421851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:26.422202 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:26.441536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:26.454299 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:26.455519 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:26.456858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 603/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:26.464230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:26.516186 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:26.596079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee28611-63ff-4a70-9f29-16e5272f48ec None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:26.644856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:26.645547 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:26.645886 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:26.646206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:26.647125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:26.647442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:26.649078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:26.660206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 606/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:26.667610 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:26.735633 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:26.800668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fe0a8-ab85-4354-b705-332297ea1da6 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:26.848935 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:26.849756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:26.850100 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:26.850293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:26.862626 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:26.864235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:26.883196 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:26.884566 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:26.885674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:26.885674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:26.885674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:26.885674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:26.885674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 604/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:26.890386 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:27.005991 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:27.008719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737e0d7-67cb-4759-96fc-66022276c615 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:27.048662 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:27.049340 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:27.049627 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:27.049907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:27.050642 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:27.050977 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:27.052358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:27.065429 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 607/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:27.071222 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:27.192150 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea92cf-4830-4d23-8f57-887d374399ee None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:27.193744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:27.229914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:27.230798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:27.231099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:27.231402 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] PATH_INFO: `/v3/users/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:27.239317 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:27.240780 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:27.256982 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:27.258271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:27.259546 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 605/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:27.264211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:27.387067 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f68c-17cf-4fa1-a562-cf0011c82ee5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:27.432351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:27.433347 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:27.433764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:27.434054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:27.435125 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:27.435495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:27.437083 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:27.463598 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 608/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:27.465152 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:27.588596 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42de5-d190-4322-b40a-75cb47ca933c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:27.631132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:27.632132 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:27.632522 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:27.632862 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:27.667481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:27.714389 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:27.716043 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:27.830145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 606/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:28:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:27.836528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:27.859733 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:27.982029 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c0b-c22e-47f5-ad59-19a62196784b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.031499 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.033038 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.033680 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.034318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.051696 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.053191 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:28.076897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:28.078165 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:28.079658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:28.079658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:28.079658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:28.079658 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:28.084664 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 609/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:28.086290 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.163763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.206243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e66ccb-e91d-4dd0-8179-eb79a6037472 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.251476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.252159 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.252479 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.252761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.253499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:28.253809 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.255259 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.268506 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 607/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:28.274137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.363024 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.398985 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edf62d-049e-4a77-9b0f-cf141aa26265 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.441522 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.442557 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.442976 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.443442 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.451508 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.453055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:28.469777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:28.471124 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:28.472223 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 610/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:28.477184 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.594411 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a55a7c-59e6-4b3b-bdad-646a73b85718 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.620761 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.633865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.634624 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.635007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.635291 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.636119 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:28.636471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.637956 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac4006-e234-4a05-acf4-6f9658ab48f6 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.650778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 608/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:28.657555 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:28.789931 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5b1c-8be6-42ad-a9ef-ab30c763be9f None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:28.831827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:28.844207 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:28.845363 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:28.845799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:28.846153 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:28.847343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=66be98232aa94878858a95694ccf60a8) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:28.847874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:28.849877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe311-56cf-469b-aa52-acc7750a528e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:28.857847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 611/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:28:28 2022] GET /identity/v3/role_assignments?user.id=66be98232aa94878858a95694ccf60a8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:31.190750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec952-8563-4430-8c19-0ed78ca84e6a None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:31.191366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec952-8563-4430-8c19-0ed78ca84e6a None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:31.191366 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec952-8563-4430-8c19-0ed78ca84e6a None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:31.193105 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 609/1220] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:31.198673 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d030-190f-46f3-88cc-af78a353582e None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:31.199138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d030-190f-46f3-88cc-af78a353582e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:31.199278 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423d030-190f-46f3-88cc-af78a353582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:31.217358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0423d030-190f-46f3-88cc-af78a353582e None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:31.218918 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0423d030-190f-46f3-88cc-af78a353582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:31.291418 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 612/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:31.319099 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec952-8563-4430-8c19-0ed78ca84e6a None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:31.441873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec952-8563-4430-8c19-0ed78ca84e6a None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:31.480454 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:31.481287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:31.481576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:31.481854 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] PATH_INFO: `/v3/roles/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:31.492474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:31.500203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:31.506532 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:31.507847 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 610/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:28:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:31.510447 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d030-190f-46f3-88cc-af78a353582e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:31.616743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423d030-190f-46f3-88cc-af78a353582e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:31.641379 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:31.653358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:31.654072 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:31.654330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:31.654608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:31.655394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:31.655701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:31.657093 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:31.666011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 613/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:31.673002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:31.722238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:31.781216 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffdda-3276-4720-bf67-86b6156f762e None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:31.815130 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:31.816002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:31.816287 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:31.816559 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:31.833686 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:31.835258 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:31.853821 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:31.855154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:31.856476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:31.856476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:31.856476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:31.856476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:31.856476 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 611/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:31.861018 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:31.977686 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7e4a-d092-47e3-a97c-5da18fbd76b5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.013086 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.013827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.014089 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.014382 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.015169 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:32.015475 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.016863 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.029161 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 614/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:32.035039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:32.135417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:32.142980 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe68ed-3a62-4a6d-9be1-91f1fecf8cac None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.181699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.183028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.183340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.183614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.191846 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.193535 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:32.209471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:32.210815 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:32.212061 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 612/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:32.216810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:32.269341 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:32.331889 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77c00-fcec-4ba1-8e74-ef340e7f7f0d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.367847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.368615 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.368897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.369177 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.370046 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:32.370358 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.371874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.390296 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 615/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:32.396154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:32.512802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385449e7-056d-4409-b602-67733fae3dd3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.548205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.548930 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.549244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.549499 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.561398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.562937 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:32.580960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:32.587278 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:32.588604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:32.588604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:32.588604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:32.588604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:32.588604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 613/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:32.588998 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:32.692962 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbf026-a186-4899-a1fe-521d78e01aad None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.695651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:32.736715 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.738009 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.738568 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.739141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.740032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:32.740395 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.742864 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.764964 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 616/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:32.766157 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:32.776722 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:32.877472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3c77-1bf0-490e-8009-bde547f4f861 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:32.912737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:32.913832 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:32.914154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:32.914540 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:32.923195 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:32.925184 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:32.943555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:32.945175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:32.946508 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 614/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:32.951575 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:33.059259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d275f2b-ba18-43d2-891e-b8f8e8102838 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:33.096109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:33.096790 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.097074 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.097351 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.098152 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:33.098464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:33.099946 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c7951-c47a-42c3-a3c8-1d5e05936dc9 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:33.113019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 617/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:33.120029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:33.191843 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:33.233732 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039138f-1c8f-4c70-981f-a283cc81e0ae None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:33.273707 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:33.274914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] REQUEST_METHOD: `PUT` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:33.275243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:33.275704 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/66be98232aa94878858a95694ccf60a8/roles/803b47860d7d4278b2a55dd687c3a1eb` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:33.294054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=66be98232aa94878858a95694ccf60a8, role_id=803b47860d7d4278b2a55dd687c3a1eb)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:33.295825 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935905ed-ddf7-4176-9cea-8a012685ec3b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:33.309213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 615/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:28:33 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/66be98232aa94878858a95694ccf60a8/roles/803b47860d7d4278b2a55dd687c3a1eb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 20:28:35.709554 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f14802-97e1-42d2-ab84-3cb6c7a09051 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.710233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f14802-97e1-42d2-ab84-3cb6c7a09051 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.710233 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f14802-97e1-42d2-ab84-3cb6c7a09051 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.711601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 618/1233] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:35.716898 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:35.717354 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:35.717766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:35.736227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:35.738081 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:35.814358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 616/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:35.840345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f14802-97e1-42d2-ab84-3cb6c7a09051 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:35.868542 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:35.977228 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f14802-97e1-42d2-ab84-3cb6c7a09051 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.015170 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.016001 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.016267 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.016546 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.027036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:36.036732 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:36.038280 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:36.039443 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 619/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Thu May 19 20:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:36.045418 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:36.099893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:36.160560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb1889-222d-431c-94e1-bb69004659eb None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.202472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.203180 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.203468 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.203734 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.204493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] RBAC: Adding query filter params (name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:36.204797 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:36.206333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:36.217162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 617/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:36.223587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:36.323250 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:36.336394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726577-b4a6-460c-8331-84d1eef426a5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.374969 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.375799 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.376078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.376353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.388051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:36.389588 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:36.408720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:36.409905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:36.411211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:36.411211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:36.411211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:36.411211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:36.411211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 620/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:36.416934 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:36.524838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef4454-14cc-411d-a763-56e95ccece3c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.536449 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:36.564750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.565627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.565974 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.566316 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.567175 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:36.567553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:36.569205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:36.584538 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 618/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:36.590616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:36.704883 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223ed6e-6723-4643-beb0-9fb3b7cfb15a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.743483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.744532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.744819 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.745121 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] PATH_INFO: `/v3/users/placement` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.748590 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:36.755243 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:36.756831 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:36.773031 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:36.774473 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:36.775907 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 621/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:36.783324 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:36.901443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d38b16-cd73-48bf-903b-a68a8f725199 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:36.945276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:36.946080 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:36.946471 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:36.946725 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:36.947976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:36.948349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:36.950164 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:36.971026 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 619/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:36.977246 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:37.084786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181e258-8c81-4cf1-a230-36ca2e51940d None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:37.123504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:37.124172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:37.124451 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:37.124726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:37.192405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:37.200077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:37.201659 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:37.313518 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 622/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:28:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:37.320488 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:37.350041 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:37.430356 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136a3e8-ea3d-437e-aa83-8e97e62f0f9b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:37.475003 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:37.475718 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:37.476066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:37.476341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:37.486996 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:37.488497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:37.508900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:37.510263 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:37.511374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:37.511374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:37.511374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:37.511374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:37.511374 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 620/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:37.516269 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:37.620279 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:37.626646 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804b2f-83a0-447e-af35-a15d1100d600 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:37.662903 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:37.663759 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:37.664241 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:37.664666 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:37.665787 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:37.666266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:37.667681 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:37.679955 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 623/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:37.685899 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:37.780178 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:37.812768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bee936-e7e9-48c0-9d42-ee159e6983ab None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:37.857372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:37.858201 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:37.858480 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:37.858793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:37.866179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:37.867793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:37.881552 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:37.882884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:37.884176 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 621/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:37.889155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:38.006495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9929-8966-4b24-b566-7c647098dfeb None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:38.043251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:38.043848 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.044131 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.044403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.045201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:38.045510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:38.047017 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dec5ad-8949-43ab-85a8-a50c2bbd0e0e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:38.059952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 624/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:38.066346 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:38.188664 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a828-17b4-494d-a306-cbe92cff9c41 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:38.224458 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:38.225310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:38.225652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:38.226135 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:38.227244 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] RBAC: Adding query filter params (role.id=803b47860d7d4278b2a55dd687c3a1eb, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=66be98232aa94878858a95694ccf60a8) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:38.227644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:38.229560 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500f32-3279-436c-a6f6-223ba5a03f16 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:38.237070 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 622/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:28:38 2022] GET /identity/v3/role_assignments?user.id=66be98232aa94878858a95694ccf60a8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=803b47860d7d4278b2a55dd687c3a1eb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:40.597274 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32aab7-3803-489e-b428-510a0baa633e None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.597926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32aab7-3803-489e-b428-510a0baa633e None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.597926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32aab7-3803-489e-b428-510a0baa633e None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.599316 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 625/1247] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 20:28:40.605548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.606074 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.606213 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.611765 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:40.625497 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:40.626778 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:40.702069 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 623/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:40.728064 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32aab7-3803-489e-b428-510a0baa633e None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:40.748905 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:40.852440 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32aab7-3803-489e-b428-510a0baa633e None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:40.888594 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:40.889407 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:40.889690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:40.889965 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:40.901345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:40.909081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:40.910567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:40.911624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 626/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:40.917344 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.037004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e24c-3e62-4a31-9e57-eb6d2b2af529 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:41.072766 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:41.079314 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:41.080386 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:41.080896 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:41.081294 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:41.082066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:41.082569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:41.085130 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:41.099303 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 624/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:41.106634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.216002 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:41.243128 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4291962-e6cc-4431-8872-f9d96407658c None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:41.286298 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:41.287300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:41.287591 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:41.287873 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:41.300143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:41.301612 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:41.320220 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:41.321639 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:41.326077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:41.326077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:41.326077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:41.326077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:41.326077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 627/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:41.327627 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.434239 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4015541-4e06-4197-a222-eb9c497cdcd9 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:41.473087 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:41.473772 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:41.474054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:41.474334 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:41.475151 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:41.475417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:41.477517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:41.491856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 625/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:41.497786 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.612603 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b93c-2ff8-4f08-a782-9d6f82c632ad None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:41.642839 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:41.652030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:41.652874 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:41.653157 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:41.653434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:41.662289 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:41.663860 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:41.679579 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:41.686290 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:41.687734 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 628/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:41.688619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.750616 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:41.799463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4707-a181-45e8-a944-54f93b2e8bfc None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:41.837789 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:41.838526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:41.838913 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:41.839227 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:41.840197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:41.840510 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:41.842091 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:41.860486 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 626/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:41.866660 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:41.999078 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dda68-4918-4e4d-b466-60c965c2c6dd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:42.037934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:42.038845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:42.039156 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:42.039530 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:42.102929 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:42.117259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:42.119043 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:42.231142 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 629/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:28:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:42.236872 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:42.348674 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b942b-6b7c-42cd-9663-5b067a630553 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:42.364157 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:42.385293 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:42.386102 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:42.386379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:42.386647 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:42.396839 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:42.398534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:42.416517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:42.422295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:42.427054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:42.427054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:42.427054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:42.427054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:42.427054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 627/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:42.427470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:42.527216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:42.539897 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683db1a0-8d68-48f5-ae8a-a7a9ee41ff73 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:42.577245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:42.577910 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:42.578257 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:42.578483 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:42.579292 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:42.579606 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:42.581051 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:42.593810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 630/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:42.602910 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:42.712994 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfbc82-3ea2-465c-8354-c0cf30a97925 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:42.751717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:42.752617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:42.752927 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:42.753209 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:42.760952 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:42.762523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:42.777327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:42.778735 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:42.780238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 628/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:42.784850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:42.890123 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eaf7b-59a7-489d-a2ab-e27762622fe5 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:42.925510 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:42.926247 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:42.926594 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:42.926884 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] PATH_INFO: `/v3/projects` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:42.927719 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:42.928036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:42.929668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0adab-8519-49e6-b439-bcf9b47900c0 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:42.943934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 631/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:42.951648 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:42.982264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:43.064900 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb526-ed51-441b-a0d4-802d0a59cbeb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:43.101221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:43.101914 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:43.102253 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:43.102553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:43.103443 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=66be98232aa94878858a95694ccf60a8) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:43.103770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:43.105342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666f20-0a73-471f-abef-81e5a11aa5fd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:43.111460 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 629/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:28:42 2022] GET /identity/v3/role_assignments?user.id=66be98232aa94878858a95694ccf60a8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:45.331360 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df8be-2bca-42ac-af5b-71b4a5c2fd2c None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.331875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df8be-2bca-42ac-af5b-71b4a5c2fd2c None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.331875 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df8be-2bca-42ac-af5b-71b4a5c2fd2c None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.333326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 632/1261] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:45.339883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.340369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.340483 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.367823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:45.369016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:45.447622 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 630/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:45.475616 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62df8be-2bca-42ac-af5b-71b4a5c2fd2c None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.487050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.594081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62df8be-2bca-42ac-af5b-71b4a5c2fd2c None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.629625 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.630411 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.630720 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.630984 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.642077 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:45.649727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:45.651225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:45.652641 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 633/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:45.657875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.684876 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.772828 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bb53f-7609-49ee-9dcd-50556c4de938 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.809553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.810226 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.810511 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.810810 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] PATH_INFO: `/v3/roles` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.811576 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] RBAC: Adding query filter params (name=admin) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:45.811886 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.813298 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:45.821846 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 631/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:45.828085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:45.898133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:45.934979 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bc522-799c-415e-aa0e-7239b2c9b5cd None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:45.975568 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:45.976478 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:45.976763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:45.977036 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:45.988054 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:45.989526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:46.006531 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:46.008027 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:46.009079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:46.009079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:46.009079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:46.009079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:46.009079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 634/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:46.014456 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.122895 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:46.151926 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7755e-4360-4b28-91cc-ca724ce8098c None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.191700 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.192722 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.193150 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.193555 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.194754 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:46.196302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.198364 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.216399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 632/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:46.222714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.336728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1e91-80fc-4c4e-a682-ac34a42da2e8 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.357824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:46.376772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.377997 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.378405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.378923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] PATH_INFO: `/v3/users/placement` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.392136 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.394406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:46.410655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:46.412016 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:46.413413 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:46.414877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 635/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:46.417806 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.524414 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64675a04-b9e9-4f1d-9765-d2f93f354672 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.559801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.560470 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.560750 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.561027 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] PATH_INFO: `/v3/users` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.561882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:46.562193 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.563705 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.572557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:46.581562 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 633/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:46.587540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.697216 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168371d-ea6f-4590-a060-91ad69eb627a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.732515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.733312 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.733593 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.733872 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.745143 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.746587 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:46.763952 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:46.765137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:46.766426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:46.766426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:46.766426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:46.766426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:46.766426 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 636/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:46.770961 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.882957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a2da-acb2-4bd0-9c8d-ca9e4d21b6bb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:46.921793 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:46.922679 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:46.923173 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:46.923530 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:46.924515 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:46.924856 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:46.926732 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:46.939834 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 634/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:46.945939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:46.978168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:47.053281 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463cde5-6bfa-4ab2-ae8e-6a1e66478d32 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:47.088311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:47.089139 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:47.089428 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:47.089701 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:47.097291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:47.098777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:47.113188 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:47.114373 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:47.115532 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 637/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 20:28:47.122042 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:47.185769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:47.234207 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c88c8-e1e3-496e-b731-fe3d50b503b7 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:47.278447 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:47.279145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:47.279424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:47.279702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:47.280505 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:47.280819 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:47.282297 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775102f9-b48b-472a-b206-fb9b6263b092 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:47.295416 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 635/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:47.305318 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:47.410640 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:47.426775 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043c86e-55eb-42d8-b6ef-7a52233c2a60 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:47.471015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:47.471917 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] REQUEST_METHOD: `PUT` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:47.472198 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:47.472476 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] PATH_INFO: `/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/66be98232aa94878858a95694ccf60a8/roles/60e0fdcdbe57455da1d4507548087fcd` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:47.474464 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] RBAC: Authorizing `identity:create_grant(project_id=49f87b3c76f9474391283d9170b1f2e9, user_id=66be98232aa94878858a95694ccf60a8, role_id=60e0fdcdbe57455da1d4507548087fcd)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:47.476003 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b485c10-015c-4dfe-81ae-8ffcd44e7e5a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:47.496961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 638/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Thu May 19 20:28:47 2022] PUT /identity/v3/projects/49f87b3c76f9474391283d9170b1f2e9/users/66be98232aa94878858a95694ccf60a8/roles/60e0fdcdbe57455da1d4507548087fcd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 20:28:49.706928 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586813c-894c-4d21-98be-d934c2aeb14b None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:49.707875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586813c-894c-4d21-98be-d934c2aeb14b None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:49.707875 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586813c-894c-4d21-98be-d934c2aeb14b None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:49.709999 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 636/1274] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:49.719583 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:49.720283 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:49.720482 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:49.741577 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:49.742850 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:49.814622 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 639/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:49.839602 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586813c-894c-4d21-98be-d934c2aeb14b None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:49.958526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586813c-894c-4d21-98be-d934c2aeb14b None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:49.979979 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:50.002191 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.003030 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.003319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.003597 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.014795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 20:28:50.022371 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:50.024893 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:50.027720 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 637/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Thu May 19 20:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:50.033602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:50.124234 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:50.144565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5607925-1a8d-4290-9420-346e7c119812 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:50.180911 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.181613 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.181899 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.182181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] PATH_INFO: `/v3/roles` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.182968 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:50.183262 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:50.184665 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:50.192958 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 640/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:50.201394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:50.306428 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d8bb-bcaa-48ad-8e3c-5eee8e48ce2b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:50.344142 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.344950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.345237 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.345517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.356937 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:50.358449 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:50.375868 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:50.377072 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:50.378369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:50.378369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:50.378369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:50.378369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:50.378369 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 638/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:50.383062 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:50.485608 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa28f6e-fbae-414c-b4ea-5626507ee3cc None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:50.523764 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.524414 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.524697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.524973 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] PATH_INFO: `/v3/domains` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.525697 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] RBAC: Adding query filter params (name=Default) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:50.526008 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:50.527409 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:50.539752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 641/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:50.546045 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:50.580340 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:50.660016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bea2e-94b4-44df-8168-af9ea5b111cb None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:50.695703 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.696517 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.696801 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.697075 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.705020 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:50.706500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 20:28:50.721466 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:50.723252 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:50.724542 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 639/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:50.729601 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:50.733774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:50.831655 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb468-6dc7-45bf-8b27-f01c817b500a None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:50.869815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:50.870495 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:50.870789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:50.871094 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] PATH_INFO: `/v3/users` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:50.871954 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:50.872268 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:50.873706 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:50.891636 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 642/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:50.900349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.005869 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.021400 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2dc4-09cf-4e12-8cf2-b51e6eb8edb3 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.066338 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.067016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.067295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.067571 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.141398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.142929 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:51.249301 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.260077 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 640/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Thu May 19 20:28:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 20:28:51.266050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.333877 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.375405 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12931-837c-4386-97f0-c1b0dca1e6e2 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.419109 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.420266 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.420747 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.421206 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.435624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.437075 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 20:28:51.461538 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:51.463404 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:51.465816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 20:28:51.465816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 20:28:51.465816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 20:28:51.465816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:51.465816 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 643/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Thu May 19 20:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:51.472770 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.590137 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be975-69d3-4f35-ba04-8cc5227becac None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.631574 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.632341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.632619 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.632890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] PATH_INFO: `/v3/domains` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.633617 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:51.633925 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.635370 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:51.647002 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 641/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Thu May 19 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:51.656050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.770777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd9cf1-7d57-4641-ac20-a3979ec08059 None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.785195 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.818102 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.819432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.819827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.820103 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.827288 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.828731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 20:28:51.843081 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application with Lock( May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:51.844328 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: ERROR keystone.server.flask.application May 19 20:28:51.845832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 644/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Thu May 19 20:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:51.850282 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:51.904312 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:51.957979 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1296-17cd-4c0c-8d54-45dbe2cd35e5 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:51.993521 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:51.994185 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:51.994462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:51.994744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] PATH_INFO: `/v3/projects` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:51.995557 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:51.995863 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:51.997333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b98b7-3514-42a3-b0a9-51a4c45da40b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:52.010251 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 642/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Thu May 19 20:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:52.017342 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:52.150433 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccbf5e-7de8-472d-bc48-6dca6a745d1b None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:52.187015 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:52.187649 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:52.187926 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:52.188201 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:52.189034 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] RBAC: Adding query filter params (role.id=60e0fdcdbe57455da1d4507548087fcd, scope.project.id=49f87b3c76f9474391283d9170b1f2e9, user.id=66be98232aa94878858a95694ccf60a8) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:52.189345 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:52.190806 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03596152-6cf7-422e-9d49-3f99847c37f2 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:52.196731 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 645/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Thu May 19 20:28:52 2022] GET /identity/v3/role_assignments?user.id=66be98232aa94878858a95694ccf60a8&scope.project.id=49f87b3c76f9474391283d9170b1f2e9&role.id=60e0fdcdbe57455da1d4507548087fcd => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:28:54.468556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054378fc-7feb-4546-83d0-4ebe16895d57 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.469472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054378fc-7feb-4546-83d0-4ebe16895d57 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.469472 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054378fc-7feb-4546-83d0-4ebe16895d57 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.471686 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 643/1288] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:54.478197 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.479010 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.479190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.501595 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:54.502893 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:54.540976 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:54.587599 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 646/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:54.610397 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054378fc-7feb-4546-83d0-4ebe16895d57 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:54.721341 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054378fc-7feb-4546-83d0-4ebe16895d57 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:54.732029 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:54.757464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:54.758283 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.758565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.758855 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] PATH_INFO: `/v3/services/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.759531 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:54.760950 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:28:54.773432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:28:54.774812 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:28:54.776053 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 644/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:28:54.781048 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:54.885166 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267ba1d-7898-4780-b884-3018e5e13476 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:54.921743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:54.922656 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:54.923122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:54.923462 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:54.924634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:54.925050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:54.927178 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b333-bd65-47b9-8e5a-e9c821d62cc4 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:54.935111 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 647/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:54.943838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:55.072816 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fbb07-84ba-47e7-88d8-cd625a77a867 None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:55.108565 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:55.109238 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:55.109518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:55.109795 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] PATH_INFO: `/v3/services` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:55.110513 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] RBAC: Adding query filter params (type=placement) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:28:55.110852 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:55.112254 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8456034-a284-4e76-9bed-ff0560cc61ea None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:55.116959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 645/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:28:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:28:57.314908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38b06-c8a2-43be-acbe-63d6084c3f23 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.315548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38b06-c8a2-43be-acbe-63d6084c3f23 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.315548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f38b06-c8a2-43be-acbe-63d6084c3f23 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.316810 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 648/1293] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:57.324141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97957-7eec-4dd7-9292-c0a706d2ebe7 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.325112 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97957-7eec-4dd7-9292-c0a706d2ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.325394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97957-7eec-4dd7-9292-c0a706d2ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.343676 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-67b97957-7eec-4dd7-9292-c0a706d2ebe7 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:57.344866 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-67b97957-7eec-4dd7-9292-c0a706d2ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:57.375643 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:57.416605 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 646/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:28:57.440227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38b06-c8a2-43be-acbe-63d6084c3f23 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:28:57.483678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:28:57.559545 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f38b06-c8a2-43be-acbe-63d6084c3f23 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:28:57.615011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:28:57.615961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:57.616380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:57.616827 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:57.618063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:28:57.619496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720f310-7884-431e-bc90-76c68a3af355 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:28:57.636784 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 649/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Thu May 19 20:28:57 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:28:59.866878 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323aebd-e0f8-42cb-912d-7f828da657a9 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:59.867823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323aebd-e0f8-42cb-912d-7f828da657a9 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:59.867823 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323aebd-e0f8-42cb-912d-7f828da657a9 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:59.870032 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 647/1296] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:28:59.876632 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:28:59.877385 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:28:59.877567 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:28:59.897807 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:28:59.899172 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:28:59.986155 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 650/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:28:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:29:00.009698 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323aebd-e0f8-42cb-912d-7f828da657a9 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:00.132214 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323aebd-e0f8-42cb-912d-7f828da657a9 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:00.170179 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:00.171018 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:00.171302 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:00.171580 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] PATH_INFO: `/v3/services/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:00.172250 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:00.173667 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:29:00.186349 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:29:00.187798 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:00.188848 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 648/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:29:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:29:00.195651 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:00.214760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:00.298548 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894b10-e4e8-41db-a83a-469d8faa58df None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:00.335399 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:00.336079 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:00.336846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:00.336846 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:00.337693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] RBAC: Adding query filter params (name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:29:00.337693 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:00.339113 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:00.344901 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 651/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:29:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:29:00.355333 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:00.392516 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:00.464221 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80e1c-8941-4eaf-9593-a05c0c74c91b None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:00.503436 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:00.504094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:00.504372 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:00.504649 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:00.505445 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] RBAC: Adding query filter params (interface=public, service_id=afe55b51035243079a56f5857622f6be, region_id=RegionOne) {{(pid=270826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:29:00.505756 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:00.507288 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b15fa-78f4-4d30-8777-1cb37a345f3c None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:00.512518 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 649/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Thu May 19 20:29:00 2022] GET /identity/v3/endpoints?service_id=afe55b51035243079a56f5857622f6be&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 20:29:00.518391 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:00.607610 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:00.628319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7b100-1fc7-4419-8093-2d829e300dae None admin] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:00.670643 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:00.671297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:00.671581 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:00.671867 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:00.672547 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:00.673925 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424a744-74fb-4774-8779-b7c9bcde20f1 None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:00.681063 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 652/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Thu May 19 20:29:00 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 20:29:02.885763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df9ff0-8606-48b9-a1a7-d68f8702e542 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:02.886399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df9ff0-8606-48b9-a1a7-d68f8702e542 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:02.886399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df9ff0-8606-48b9-a1a7-d68f8702e542 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:02.887759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 650/1302] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:29:02.894190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:02.895011 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:02.895221 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:02.915526 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:29:02.916714 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:29:02.993291 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 653/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:29:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 20:29:03.016015 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df9ff0-8606-48b9-a1a7-d68f8702e542 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:03.129111 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:03.140561 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df9ff0-8606-48b9-a1a7-d68f8702e542 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:03.180358 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:03.181194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:03.181481 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:03.181759 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:03.182427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:03.183889 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 20:29:03.195851 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 20:29:03.197269 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.get_or_create( May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application with Lock( May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self._enter() May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application return self.creator() May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application created_value = creator( May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: ERROR keystone.server.flask.application May 19 20:29:03.198304 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 651/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Thu May 19 20:29:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 20:29:03.203436 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:03.289069 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:03.313781 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d45e7c-28e0-4cda-8c4c-ff11fcb8a135 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:03.348244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:03.348915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:03.349194 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:03.349504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] PATH_INFO: `/v3/services` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:03.350225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] RBAC: Adding query filter params (name=placement) {{(pid=270827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 20:29:03.350528 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:03.352052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae868a-f5fe-4c0e-a26f-1ca88360612e None admin] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:03.357117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 654/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Thu May 19 20:29:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 20:29:03.363310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:29:03.475464 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1ccb-2f56-4c3f-b7bf-13d4fa36b7cd None admin] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:29:03.509500 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f100ebbb9b184141b0c51253d104fc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:29:03.510143 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:29:03.510427 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:29:03.510732 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:29:03.511462 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:29:03.512874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b553a39-4ec9-42e1-8308-1753ddd269bc None admin] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:29:03.535422 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 652/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Thu May 19 20:29:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 20:29:13.354540 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=30 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:29:13.531048 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:10.789159 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23119-2f51-4f43-b5f5-61c207620cdf None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:10.789815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23119-2f51-4f43-b5f5-61c207620cdf None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:10.789815 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf23119-2f51-4f43-b5f5-61c207620cdf None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:10.791743 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 655/1307] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:10.797327 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49061-f5bf-4f99-83b1-742fdd63efab None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:10.797829 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49061-f5bf-4f99-83b1-742fdd63efab None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:10.797936 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a49061-f5bf-4f99-83b1-742fdd63efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:10.949310 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-c9a49061-f5bf-4f99-83b1-742fdd63efab None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:10.950457 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-c9a49061-f5bf-4f99-83b1-742fdd63efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:11.182036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 653/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:11.238840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:11.239403 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:11.239841 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:11.241470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 656/1309] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:11.249947 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6e82-1400-4b1d-9059-adaf0aa02bd6 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:11.250243 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6e82-1400-4b1d-9059-adaf0aa02bd6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:11.250526 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6e82-1400-4b1d-9059-adaf0aa02bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:11.406398 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-97fd6e82-1400-4b1d-9059-adaf0aa02bd6 None None] MFA Rules not processed for user `ecfc0c1a9b56419fbe33fc10047075b8`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:11.407714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-97fd6e82-1400-4b1d-9059-adaf0aa02bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:11.458066 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:11.566276 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 654/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:11.575069 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:11.577117 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:11.743453 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb472adb-b6b4-4aa8-a6a6-a700e7bde834 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:11.827939 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:11.828602 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:11.828792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:11.829068 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:11.830772 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:11.887624 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:12.013416 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:12.015057 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9940d9d-15d6-4992-add3-6a14e2e6c5c0 service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:12.057249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 657/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:14.864474 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:14.865039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:14.865039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:14.872634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377ae6-d35d-424b-8dac-8d27fae35941 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:14.872634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377ae6-d35d-424b-8dac-8d27fae35941 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:14.872634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73377ae6-d35d-424b-8dac-8d27fae35941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:14.875060 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 655/1312] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:14.968044 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-73377ae6-d35d-424b-8dac-8d27fae35941 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:14.970213 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-73377ae6-d35d-424b-8dac-8d27fae35941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:15.111770 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 658/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:30:15.139621 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:15.141652 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:15.268944 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e4639-59aa-4d67-9786-815d8c11b459 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:15.358551 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:15.362441 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:15.363208 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:15.363609 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:15.364056 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:15.367181 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:15.505877 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:15.507603 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde79c0-135c-46ff-851a-911670627347 service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:15.530028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 656/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:18.204699 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:18.205249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:18.205249 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:18.206585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 659/1315] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:18.213534 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140a202-f6f2-4bc5-bad0-6ed82de36f1c None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:18.214039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140a202-f6f2-4bc5-bad0-6ed82de36f1c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:18.214144 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140a202-f6f2-4bc5-bad0-6ed82de36f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:18.293951 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-e140a202-f6f2-4bc5-bad0-6ed82de36f1c None None] MFA Rules not processed for user `ad3237a70cf647d2954966a44b02415b`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:18.295205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-e140a202-f6f2-4bc5-bad0-6ed82de36f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:18.351394 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:18.397197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 657/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:18.439730 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:18.441300 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:18.452481 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:18.556406 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeea3a-27f0-46f3-92ce-a809780614d2 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:18.637524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:18.638185 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:18.638470 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:18.638777 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:18.640486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:18.705817 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:18.757740 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:18.759245 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b6fe-a61a-4a8e-93f6-8214a88a74b4 service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:18.787634 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 660/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:21.614162 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:21.614662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:21.614662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:21.616163 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 658/1318] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:21.621585 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb621-f811-44e7-a522-2b64efbfdf79 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:21.622034 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb621-f811-44e7-a522-2b64efbfdf79 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:21.622135 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb621-f811-44e7-a522-2b64efbfdf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:21.691842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-eb8fb621-f811-44e7-a522-2b64efbfdf79 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:21.693189 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-eb8fb621-f811-44e7-a522-2b64efbfdf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:21.795251 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 661/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:21.834359 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:21.835938 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:21.956118 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381f50-b487-488b-84fd-c634f00c777c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:22.034844 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:22.035509 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:22.035788 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:22.036051 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:22.037760 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:22.045712 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:22.153693 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:22.155220 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52f40-dd3b-4b52-afff-e1d244fe4afc service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:22.173362 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 659/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:25.094849 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016ae-504b-4a61-877f-087d07e5c03d None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:25.095504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016ae-504b-4a61-877f-087d07e5c03d None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:25.095504 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270016ae-504b-4a61-877f-087d07e5c03d None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:25.096811 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 662/1321] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:25.102282 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86f4d6-1444-48c9-b7ea-99dbfa56936c None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:25.102820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86f4d6-1444-48c9-b7ea-99dbfa56936c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:25.102820 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86f4d6-1444-48c9-b7ea-99dbfa56936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:25.168638 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-2f86f4d6-1444-48c9-b7ea-99dbfa56936c None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:25.169850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-2f86f4d6-1444-48c9-b7ea-99dbfa56936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:25.232838 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:25.275940 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 660/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:25.327879 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:25.328723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:25.328723 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:25.329842 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 663/1323] 10.222.0.77 () {54 vars in 964 bytes} [Thu May 19 20:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:25.336641 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57310ed-fac7-430d-abf9-0fbb9ce65ac8 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:25.337004 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57310ed-fac7-430d-abf9-0fbb9ce65ac8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:25.337345 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57310ed-fac7-430d-abf9-0fbb9ce65ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:25.415417 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-a57310ed-fac7-430d-abf9-0fbb9ce65ac8 None None] MFA Rules not processed for user `ecfc0c1a9b56419fbe33fc10047075b8`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:25.416636 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-a57310ed-fac7-430d-abf9-0fbb9ce65ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:25.498763 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 661/1324] 10.222.0.77 () {58 vars in 1061 bytes} [Thu May 19 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:25.508122 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:25.509763 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:25.532368 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:25.623380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb88da6-b7bd-4c78-bc3d-4e98b250e607 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:25.706026 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:25.706834 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:25.707296 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:25.707661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:25.709739 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:25.796244 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:25.836760 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:25.838225 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5343ba9-8a9c-4eda-8ce1-cc3aa925a11a service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:25.857055 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 664/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:28.356271 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2c96-262c-4199-950c-2b102523119e None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:28.356850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2c96-262c-4199-950c-2b102523119e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:28.356850 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2c96-262c-4199-950c-2b102523119e None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:28.358873 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 662/1326] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:28.364486 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e11f-130a-479e-b1dd-9405d6d0d3a8 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:28.364936 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e11f-130a-479e-b1dd-9405d6d0d3a8 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:28.365104 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693e11f-130a-479e-b1dd-9405d6d0d3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:28.455052 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-7693e11f-130a-479e-b1dd-9405d6d0d3a8 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:28.456286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-7693e11f-130a-479e-b1dd-9405d6d0d3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:28.560933 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 665/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:28.597203 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a2c96-262c-4199-950c-2b102523119e None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:28.599806 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-756a2c96-262c-4199-950c-2b102523119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:28.669477 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:28.717212 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a2c96-262c-4199-950c-2b102523119e None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:28.799842 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:28.800666 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:28.800955 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:28.801234 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:28.803031 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:28.929818 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:28.933146 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:28.935039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cd4f3-b997-4c71-ba07-7d282fe6bb71 service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:28.956170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 663/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:31.244659 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:31.245319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:31.245319 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:31.246923 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 666/1329] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:31.253186 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a91b9-5229-4e67-b1b1-87ca8032d6aa None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:31.253668 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a91b9-5229-4e67-b1b1-87ca8032d6aa None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:31.253792 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a91b9-5229-4e67-b1b1-87ca8032d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:31.325149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-ed0a91b9-5229-4e67-b1b1-87ca8032d6aa None None] MFA Rules not processed for user `ad3237a70cf647d2954966a44b02415b`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:31.326523 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-ed0a91b9-5229-4e67-b1b1-87ca8032d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:31.430172 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 664/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:31.469736 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:31.471506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:31.504360 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:31.578823 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66549ecf-f9a2-4397-9013-0a9448152229 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:31.654282 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:31.654976 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:31.655253 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:31.655524 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:31.657204 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:31.737326 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:31.770446 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:31.771942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ec56-cf2f-400c-838b-9eae31e50cc5 service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:31.790480 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 667/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:34.279702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:34.280292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:34.280292 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:34.281702 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 665/1332] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:34.287394 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea057da-215d-479b-89a2-dc6868e0ab24 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:34.287891 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea057da-215d-479b-89a2-dc6868e0ab24 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:34.288014 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea057da-215d-479b-89a2-dc6868e0ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:34.359432 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-5ea057da-215d-479b-89a2-dc6868e0ab24 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:34.360632 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-5ea057da-215d-479b-89a2-dc6868e0ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:34.460235 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 668/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:34.496738 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:34.498300 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:34.572985 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:34.608870 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506128d-2c25-4154-90f7-27d1ed7d549c None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:34.684655 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:34.685319 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:34.685599 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:34.685874 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:34.687569 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:34.803890 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:34.805390 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574a89d-e953-4d04-b445-23022fcbca46 service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:34.815620 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:34.824007 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 666/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:37.075085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:37.075694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:37.075694 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:37.077050 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 669/1335] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:37.082536 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043478f5-5e69-41bd-87d7-7f56b9aca779 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:37.083129 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043478f5-5e69-41bd-87d7-7f56b9aca779 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:37.083295 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043478f5-5e69-41bd-87d7-7f56b9aca779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:37.153424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-043478f5-5e69-41bd-87d7-7f56b9aca779 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:37.154662 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-043478f5-5e69-41bd-87d7-7f56b9aca779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:37.254960 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 667/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:37.295434 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:37.296994 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:37.339942 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:37.406339 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b192aa6-4bfc-4eca-a5a5-b8da97c2cbc1 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:37.481845 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:37.482506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:37.482832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:37.483090 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:37.484752 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:37.573871 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:37.601428 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:37.602915 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6cfd9-1a5b-4b3a-9db9-23f5b777fa58 service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:37.621448 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 670/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:40.525103 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:40.526039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:40.526039 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:40.528332 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 668/1338] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:40.536566 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c169-b6c7-4d06-8d78-11a5abe174e5 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:40.537039 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c169-b6c7-4d06-8d78-11a5abe174e5 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:40.537148 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c169-b6c7-4d06-8d78-11a5abe174e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:40.605614 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-be83c169-b6c7-4d06-8d78-11a5abe174e5 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:40.606792 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-be83c169-b6c7-4d06-8d78-11a5abe174e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:40.715297 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 671/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:30:40.761017 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:40.762556 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:40.845197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:40.879572 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666c944-fec1-4354-96c2-698abc2da973 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:40.957122 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:40.957775 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:40.958092 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:40.958399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:40.960723 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:41.081138 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:41.082594 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e1758-a091-498e-9ceb-0004e505acf5 service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:41.102871 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 669/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:45.553961 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:45.554500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:45.554500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:45.555975 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 672/1341] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:45.561550 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8409e-0809-4b50-b6fd-8b3c990dffdb None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:45.561977 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8409e-0809-4b50-b6fd-8b3c990dffdb None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:45.562194 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8409e-0809-4b50-b6fd-8b3c990dffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:45.568323 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=100 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:45.614614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-ecb8409e-0809-4b50-b6fd-8b3c990dffdb None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:45.615858 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-ecb8409e-0809-4b50-b6fd-8b3c990dffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:45.698988 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 670/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:45.738116 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:45.740559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:45.790840 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:30:45.824042 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513324ef-9d38-4c9b-a3f2-7b0272659d02 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:45.828019 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:45.828690 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:45.828971 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:45.829248 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:45.839211 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:45.840668 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9cfb8-85d0-4f36-9ac2-b188dbaf58e1 service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:45.850629 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 673/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:48.691544 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:48.692170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:48.692170 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:48.693604 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 671/1344] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:48.699096 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d8b68-df80-42ed-b42d-ef1cb8d73315 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:48.699597 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d8b68-df80-42ed-b42d-ef1cb8d73315 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:48.699702 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d8b68-df80-42ed-b42d-ef1cb8d73315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:48.729336 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-982d8b68-df80-42ed-b42d-ef1cb8d73315 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:48.730560 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-982d8b68-df80-42ed-b42d-ef1cb8d73315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:48.749217 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 674/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:48.786957 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:48.789205 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:48.804533 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155973e8-37c5-4df2-9d9b-2cdc2bcd6e33 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:48.808769 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:48.809424 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:48.809710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:48.809992 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:48.819392 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:48.820865 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b9173-b736-455a-a5ad-fb6dd5b5c4c7 service neutron] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:48.830432 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 672/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:53.280353 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5323-375b-4025-bfc7-f5a477c7e914 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:53.280908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5323-375b-4025-bfc7-f5a477c7e914 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:53.280908 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5323-375b-4025-bfc7-f5a477c7e914 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:53.282230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 675/1347] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:53.288109 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093772-81d9-43e0-9fe4-e7780a4601d6 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:53.288587 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093772-81d9-43e0-9fe4-e7780a4601d6 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:53.288737 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093772-81d9-43e0-9fe4-e7780a4601d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:53.307743 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-9a093772-81d9-43e0-9fe4-e7780a4601d6 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:53.308959 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-9a093772-81d9-43e0-9fe4-e7780a4601d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:53.321574 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 673/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:30:53.360934 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5323-375b-4025-bfc7-f5a477c7e914 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:30:53.373032 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5323-375b-4025-bfc7-f5a477c7e914 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:30:53.376855 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecfc0c1a9b56419fbe33fc10047075b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:30:53.377506 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:53.377789 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:53.378264 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:53.387832 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:30:53.389270 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daed84-69d3-4923-bc3a-a32c8604950c service neutron] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:30:53.399098 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 676/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:30:58.990849 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5102-e55a-4be6-b22d-f629896edcfa None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:58.991744 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5102-e55a-4be6-b22d-f629896edcfa None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:58.992197 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5102-e55a-4be6-b22d-f629896edcfa None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:58.994057 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 674/1350] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:30:59.003574 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692aa3d-2e04-4433-9d2d-e3e98a331081 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:30:59.004559 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692aa3d-2e04-4433-9d2d-e3e98a331081 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:30:59.005311 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692aa3d-2e04-4433-9d2d-e3e98a331081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:30:59.142137 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-8692aa3d-2e04-4433-9d2d-e3e98a331081 None None] MFA Rules not processed for user `66be98232aa94878858a95694ccf60a8`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:30:59.143380 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-8692aa3d-2e04-4433-9d2d-e3e98a331081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:30:59.222190 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 677/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:30:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 20:31:03.301882 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=52 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:31:03.763548 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86a7f-e023-4b80-a0db-7bb5837a0d6d None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:03.764123 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86a7f-e023-4b80-a0db-7bb5837a0d6d None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:03.764399 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c86a7f-e023-4b80-a0db-7bb5837a0d6d None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:03.765976 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 675/1352] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:03.771343 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3c75-c59b-49a9-930d-497ef27551a3 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:03.771869 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3c75-c59b-49a9-930d-497ef27551a3 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:03.771963 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb3c75-c59b-49a9-930d-497ef27551a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:03.790812 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-3fdb3c75-c59b-49a9-930d-497ef27551a3 None None] MFA Rules not processed for user `66be98232aa94878858a95694ccf60a8`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:03.792359 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-3fdb3c75-c59b-49a9-930d-497ef27551a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:03.801505 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 678/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:05.299028 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323e96-460c-4727-873b-e667c14b9849 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:05.299595 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323e96-460c-4727-873b-e667c14b9849 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:05.299714 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323e96-460c-4727-873b-e667c14b9849 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:05.301264 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 676/1354] 10.222.0.77 () {54 vars in 921 bytes} [Thu May 19 20:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:05.306824 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cc6d-6df6-4940-bdce-70dd2f4449a2 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:05.307284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cc6d-6df6-4940-bdce-70dd2f4449a2 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:05.307377 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640cc6d-6df6-4940-bdce-70dd2f4449a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:05.326496 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-b640cc6d-6df6-4940-bdce-70dd2f4449a2 None None] MFA Rules not processed for user `66be98232aa94878858a95694ccf60a8`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:05.327753 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-b640cc6d-6df6-4940-bdce-70dd2f4449a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:05.337306 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 679/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Thu May 19 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:09.178059 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66243ebc-6c5d-4557-8182-b31d35f1a99e None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:09.178618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66243ebc-6c5d-4557-8182-b31d35f1a99e None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:09.178618 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66243ebc-6c5d-4557-8182-b31d35f1a99e None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:09.180145 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 677/1356] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:09.185700 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395a45-9f42-40ed-a84e-44cb052a145f None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:09.186200 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395a45-9f42-40ed-a84e-44cb052a145f None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:09.186314 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395a45-9f42-40ed-a84e-44cb052a145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:09.219982 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-57395a45-9f42-40ed-a84e-44cb052a145f None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:09.221184 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-57395a45-9f42-40ed-a84e-44cb052a145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:09.229847 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 680/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:09.285553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53baf-a71c-482d-9736-d527757e4b72 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:09.286141 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53baf-a71c-482d-9736-d527757e4b72 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:09.286644 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53baf-a71c-482d-9736-d527757e4b72 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:09.288691 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 678/1358] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:09.296749 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604893-63f0-4021-8482-818c8f223387 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:09.297030 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604893-63f0-4021-8482-818c8f223387 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:09.297322 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c604893-63f0-4021-8482-818c8f223387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:09.340677 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=100 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:31:09.365774 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-8c604893-63f0-4021-8482-818c8f223387 None None] MFA Rules not processed for user `3f6fce810ff642dfa15292494084197e`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:09.367259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-8c604893-63f0-4021-8482-818c8f223387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:09.474862 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 681/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:09.477251 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53baf-a71c-482d-9736-d527757e4b72 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:31:09.492351 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53baf-a71c-482d-9736-d527757e4b72 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:31:09.498379 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f6fce810ff642dfa15292494084197e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:31:09.499149 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:09.499504 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:09.499853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:09.508710 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:31:09.510453 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ddca5-f9dd-4b46-a35f-08143508864d service nova] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:31:09.520342 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 679/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:31:11.972193 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb627-f299-4d6b-bccd-3a621d31c047 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:11.972809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb627-f299-4d6b-bccd-3a621d31c047 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:11.972809 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb627-f299-4d6b-bccd-3a621d31c047 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:11.974138 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 682/1361] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:11.980093 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817b3c-972f-441c-9463-6d04d6f1f6d2 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:11.980920 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817b3c-972f-441c-9463-6d04d6f1f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:11.981094 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817b3c-972f-441c-9463-6d04d6f1f6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:12.004656 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-8c817b3c-972f-441c-9463-6d04d6f1f6d2 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:12.005883 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-8c817b3c-972f-441c-9463-6d04d6f1f6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:12.014035 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 680/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:12.058728 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb627-f299-4d6b-bccd-3a621d31c047 None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:31:12.073956 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb627-f299-4d6b-bccd-3a621d31c047 None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:31:12.079856 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f6fce810ff642dfa15292494084197e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:31:12.080517 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:12.080803 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:12.081085 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:12.093330 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:31:12.096500 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23980573-e246-489c-b343-bdf332e89c99 service nova] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:31:12.110501 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 683/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:31:14.650052 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668e-1cd5-481f-9395-3667bec49c2d None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:14.651008 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668e-1cd5-481f-9395-3667bec49c2d None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:14.651270 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e668e-1cd5-481f-9395-3667bec49c2d None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:14.652853 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 681/1364] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:14.658653 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248ba11-6890-4cd3-8ed3-80fddb98f143 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:14.659141 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248ba11-6890-4cd3-8ed3-80fddb98f143 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:14.659352 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248ba11-6890-4cd3-8ed3-80fddb98f143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:14.681286 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-c248ba11-6890-4cd3-8ed3-80fddb98f143 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:14.682530 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-c248ba11-6890-4cd3-8ed3-80fddb98f143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:14.690671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 684/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:14.741016 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf710d7-2c87-4501-8c1c-8780844a9cf8 None None] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:14.741584 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf710d7-2c87-4501-8c1c-8780844a9cf8 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:14.741884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf710d7-2c87-4501-8c1c-8780844a9cf8 None None] PATH_INFO: `/` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:14.743360 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 682/1366] 10.222.0.77 () {54 vars in 961 bytes} [Thu May 19 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:14.749656 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4960a-4de3-4684-84cc-7a9a8980f205 None None] REQUEST_METHOD: `POST` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:14.749947 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4960a-4de3-4684-84cc-7a9a8980f205 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:14.750227 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4960a-4de3-4684-84cc-7a9a8980f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:14.772661 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.auth.core [None req-0ee4960a-4de3-4684-84cc-7a9a8980f205 None None] MFA Rules not processed for user `3f6fce810ff642dfa15292494084197e`. Rule list: `[]` (Enabled: `True`). {{(pid=270827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:14.774037 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.fernet_utils [None req-0ee4960a-4de3-4684-84cc-7a9a8980f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:14.784284 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 685/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Thu May 19 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:14.799986 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf710d7-2c87-4501-8c1c-8780844a9cf8 None None] Authenticating user token {{(pid=270826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:31:14.815154 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf710d7-2c87-4501-8c1c-8780844a9cf8 None None] Validating token access rules against request {{(pid=270826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:31:14.820665 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f6fce810ff642dfa15292494084197e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:31:14.821322 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] REQUEST_METHOD: `GET` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:14.821607 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:14.821884 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:14.830768 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:31:14.832614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f19c3-46af-4c1a-be86-162bc94ad5cd service nova] RBAC: Authorization granted {{(pid=270826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:31:14.843036 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 683/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:31:15.823133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd602-c5aa-448b-9444-43c8637cb760 None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:15.823993 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd602-c5aa-448b-9444-43c8637cb760 None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:15.824259 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd602-c5aa-448b-9444-43c8637cb760 None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:15.825678 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 686/1369] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:15.831634 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4789b7-f42b-44ad-995d-f6ac45cb82ba None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:15.832235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4789b7-f42b-44ad-995d-f6ac45cb82ba None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:15.832235 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4789b7-f42b-44ad-995d-f6ac45cb82ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:15.852463 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-cd4789b7-f42b-44ad-995d-f6ac45cb82ba None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:15.854413 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-cd4789b7-f42b-44ad-995d-f6ac45cb82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:15.863802 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 684/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:17.126515 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da228579-12a5-453e-83c4-7feaad21f4dc None None] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:17.127133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da228579-12a5-453e-83c4-7feaad21f4dc None None] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:17.127133 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da228579-12a5-453e-83c4-7feaad21f4dc None None] PATH_INFO: `/` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:17.128671 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 687/1371] 10.222.0.77 () {54 vars in 926 bytes} [Thu May 19 20:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 20:31:17.134096 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63432f9-a36f-486b-b339-d9890cf4f0a3 None None] REQUEST_METHOD: `POST` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:17.134553 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63432f9-a36f-486b-b339-d9890cf4f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:17.134717 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63432f9-a36f-486b-b339-d9890cf4f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=270826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:17.153675 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.auth.core [None req-d63432f9-a36f-486b-b339-d9890cf4f0a3 None None] MFA Rules not processed for user `f100ebbb9b184141b0c51253d104fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=270826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 20:31:17.155054 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG keystone.common.fernet_utils [None req-d63432f9-a36f-486b-b339-d9890cf4f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=270826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 20:31:17.163614 dv-cinder-835881-13-smb devstack@keystone.service[270826]: [pid: 270826|app: 0|req: 685/1372] 10.222.0.77 () {58 vars in 1023 bytes} [Thu May 19 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 20:31:17.207565 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da228579-12a5-453e-83c4-7feaad21f4dc None None] Authenticating user token {{(pid=270827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 20:31:17.223230 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da228579-12a5-453e-83c4-7feaad21f4dc None None] Validating token access rules against request {{(pid=270827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 20:31:17.229181 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f6fce810ff642dfa15292494084197e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49f87b3c76f9474391283d9170b1f2e9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=270827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 20:31:17.229878 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] REQUEST_METHOD: `GET` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 20:31:17.230168 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] SCRIPT_NAME: `/identity` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 20:31:17.230454 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=270827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 20:31:17.239254 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 20:31:17.240980 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5cbce-7260-43d7-9d2b-96cc5bbe89ce service nova] RBAC: Authorization granted {{(pid=270827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 20:31:17.251727 dv-cinder-835881-13-smb devstack@keystone.service[270827]: [pid: 270827|app: 0|req: 688/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Thu May 19 20:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 20:31:27.148493 dv-cinder-835881-13-smb devstack@keystone.service[270826]: DEBUG dbcounter [-] [270826] Writing DB stats keystone:SELECT=21 {{(pid=270826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:31:27.246726 dv-cinder-835881-13-smb devstack@keystone.service[270827]: DEBUG dbcounter [-] [270827] Writing DB stats keystone:SELECT=60 {{(pid=270827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 20:31:47.560669 dv-cinder-835881-13-smb systemd[1]: Stopping Devstack devstack@keystone.service... May 19 20:31:47.561061 dv-cinder-835881-13-smb devstack@keystone.service[270812]: Thu May 19 20:31:47 2022 - graceful shutdown triggered... May 19 20:31:47.561699 dv-cinder-835881-13-smb devstack@keystone.service[270826]: Gracefully killing worker 1 (pid: 270826)... May 19 20:31:47.562252 dv-cinder-835881-13-smb devstack@keystone.service[270827]: Gracefully killing worker 2 (pid: 270827)... May 19 20:31:48.562333 dv-cinder-835881-13-smb devstack@keystone.service[270812]: worker 1 buried after 1 seconds May 19 20:31:48.562333 dv-cinder-835881-13-smb devstack@keystone.service[270812]: worker 2 buried after 1 seconds May 19 20:31:48.562333 dv-cinder-835881-13-smb devstack@keystone.service[270812]: goodbye to uWSGI. May 19 20:31:48.564891 dv-cinder-835881-13-smb systemd[1]: devstack@keystone.service: Succeeded. May 19 20:31:48.565786 dv-cinder-835881-13-smb systemd[1]: Stopped Devstack devstack@keystone.service.